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Chapter 1 A) 
Introduction E 


1.1 Background 


In string theory, the term “brane” is used for certain extended objects. As is typical 
of string theory, there are many different ways of seeing or defining these objects, 
depending on one’s preferred point of view. For example, from the target space per- 
spective, where string theory can be thought of as modeling the motion of strings 
in a target space X, one can picture branes as particular distinguished submanifolds 
of X (decorated with additional data) on which open strings can end. Relatedly, from 
the point of view of the string worldsheet, branes are simply boundary conditions 
of the two-dimensional worldsheet theory. But branes can also be viewed as sources 
for higher-form gauge symmetries in the effective field theory of the target space. In 
the supergravity approximation, such extended sources produce interesting solutions, 
called “black branes” by analogy with familiar “black hole” solutions in standard gen- 
eral relativity. This perspective is especially useful in eleven-dimensional M-theory, 
where a first-quantization perspective (which would replace the string worldsheet by 
an appropriate “membrane” theory) is currently unavailable. 

Branes, or at least models of certain special versions of branes, have also made 
numerous appearances in the mathematics literature, where they may go by different 
names. For example, topological string theory (which, from the physical point of 
view, comes from a twist of the worldsheet sigma-model discussed above) comes 
in two flavors, known as the A- and B-models. The category of branes in each 
of these can be identified with a fairly well-defined mathematical structure associ- 
ated to a Calabi—Yau target space X. For the B-model, this is the derived category 
of coherent sheaves on X, whereas the A-model is expected to be some appropri- 
ately defined version of—or generalization of—the Fukaya category Fuk(X, wx), 
where wx is the symplectic form. Since this generalization may be nontrivial, we 
will write A-Brane(X, wx) for the category of A-branes, in which Fuk(X, wx) is 
expected to be a full subcategory. The homological mirror symmetry proposal of 
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Kontsevich [110] identifies the category of A-branes on a Calabi—Yau threefold with 
the category of B-branes on its mirror, and is the subject of ongoing intense mathe- 
matical research. 

While the category of B-branes belongs squarely to the realm of algebraic geom- 
etry, the category of A-branes is much more subtle, and has appeared in numerous 
different guises in mathematical physics. To give another example, the proposed 
framework of brane quantization [85] suggests that the problem of quantizing a 
symplectic manifold M can be approached by studying the topological A-model on 
a different target space X, which is chosen to be a so-called “complexification” of M. 
(When M is the set of real points of an algebraic symplectic manifold, this complex- 
ification can be taken to be the obvious one.) This complexification should, in any 
case, be a complex manifold whose dimension is twice that of M; M should map 
to X, and X should be equipped with a holomorphic symplectic form 9, whose real 
part Re Q restricts to the symplectic form on M, and imaginary part Im Q restricts 
to zero on M. 

One is then instructed to consider the A-model of the complexification with respect 
to the imaginary part of the holomorphic symplectic form, wx = Im Q. This gives 
rise to a category A-Brane(X, wx) of A-branes, which includes not only Lagrangian 
objects but also much more unfamiliar branes supported on coisotropic submanifolds 
of X. Coisotropic branes were introduced in [8, 107] conjectured that spaces of 
morphisms between A-branes should be identified with deformation quantizations 
of the functions on their intersections. While coisotropic branes remain mysterious 
in general, and do not occur at all on simply-connected Calabi—Yau three-folds, they 
are needed for mirror symmetry to work, even on flat target spaces. 

In fact, since the dimension of X is always zero modulo four, one can define a 
particularly useful exotic A-brane on X, known as the canonical coisotropic brane. 
This brane was introduced in [117], where it played an important role in connecting 
A-branes to D-modules. Its support is the entire space X, and it is furthermore 
expected to have a very interesting algebra of endomorphisms. In fact, in keeping 
with the proposal of [8], one expects that 


End(Bec) = 64 (XK), (1.1) 


where the object on the right-hand side is the deformation quantization of the ring 
O (X) of holomorphic functions (with appropriate polynomial growth conditions at 
infinity) on the complexification, taken with respect to its holomorphic symplectic 
form. In the case of an affine variety, @ (Æ) is just the coordinate ring. (Although the 
A-model depends only on the symplectic form wx = Im Q, the real part of Q enters 
the definition of the boundary condition Bec, which is only canonically definable on 
a holomorphic symplectic manifold.) 

As with any category, there is an action of this algebra by precomposition (physi- 
cally speaking, by joining strings at boundary conditions) on the space of morphisms 
from Bec to any other A-brane %. In other words, brane quantization naturally 
proposes a functor 
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Hom(B¢c, —) : A-Brane(X, wx) > Rep(@7(X)), (1.2) 


which allows us to generate a representation of this algebra from an A-brane. A 
category is said to be generated by an object A if Hom(A, —) is an equivalence 
of categories. In fact, Kapustin [98] proposed that Bec is a generating object of 
the category of A-branes, and that Rep(@?(X)) can be taken as a definition of the 
category A-Brane(X), when X is a hyper-Kahler space. We remark that there are 
some subtleties here. The Fukaya category as typically studied in homological mirror 
symmetry [110] requires each object to carry a choice of grading, so that there is 
at least a family of A-branes supported on the same Lagrangian which are shifts of 
one another, forming a torsor over Z. There is typically no canonical choice of a 
preferred grading datum on an A-brane. One should more properly expect 


RHom(B¢c, —) : D?A-Brane(X, wx) > D’ Rep(@7(X)) (1.3) 


to provide a derived equivalence between the category of A-branes and the derived 
category of @7(X)-modules. (From the physical perspective, this corresponds to 
working with the notion of equivalence appropriate to the twist, treating A-branes 
as boundaries for the A-twisted theory rather than boundaries for the full theory 
that are compatible with the twist.) The relevance of derived categories to boundary 
conditions in topological string theory has been understood for a long time; see [46, 
for example]. 

Returning briefly to the perspective of brane quantization, the gist now consists 
in the fact that M is a Lagrangian submanifold in (X, wx), so that the original 
symplectic manifold itself can be used to define an A-brane By in (X, wx). In fact, 
itis shown in [82, 85] that the morphism space Hom(%8,-, Bm) can be identified in a 
precise fashion with the geometric quantization of M, at least under the assumption 
that M is a Kahler manifold. As such, brane quantization provides a bridge between 
deformation quantization—which is guaranteed to formally produce the algebra of 
quantum observables 6*4 (£), but gives no candidate for a natural module or Hilbert 
space on which it acts—and standard geometric quantization. (For a recent study of 
issues in geometric quantization from this perspective, see [87].) However, as we have 
already argued, the functor Hom (Bec, —) is much more than this: assuming that it is 
an equivalence, it provides a natural description of the category of G7 (X)-modules 
in geometric terms. Indeed, the role of M in the story is no longer distinguished: it 
is just one A-brane among (at least potentially) many, each of which corresponds 
naturally to an @7(X)-module. This broader perspective was already appreciated 
in [85], where a particular space X = T*CP! was used to generalize the orbit method 
and give geometric constructions for all representations of SL(2, R). Therefore, the 
proposed equivalence (1.3) between A-branes and @7(X)-modules is the natural 
way to think about a geometric approach to representation theory for algebras that 
deformation-quantize hyper-Kahler manifolds X. 

As the definition of the A-brane category is not available yet, much of this discus- 
sion is not at a mathematical level of rigor. Nonetheless, with an appropriate choice 
of (X, wx), we can provide concrete evidence for the equivalence (1.3) if we restrict 
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ourselves to Lagrangian objects belonging to the Fukaya category Fuk(X, wx) of X, 
which forms a subcategory in A-Brane(X, wx). We will take the target space X of 
the 2d sigma-model to be the moduli space of complex flat connections (or parabolic 
Higgs bundles) on a once-punctured torus C,,. Then, as proved in [131], the algebra 
O47 (X) will be the spherical subalgebra of double affine Hecke algebra (DAHA in 
short) [35]. One of our goals in this paper is to explore the idea described above in 
this setup, presenting solid evidence for the equivalence (1.3).! 


Remark: In the past few years, Kontsevich and Soibelman [113] have been devel- 
oping a new formalism within the framework of ‘holomorphic Floer theory,’ which 
among other things, allows for a rigorous formulation of brane quantization. Accord- 
ing to the generalized Riemann—Hilbert correspondence of Kontsevich—Soibelman, 
there is an embedding of the Fukaya category Fuk() into the right-hand side of 
(1.3) as the category of so-called holonomic D,-modules. Their approach provides 
a realization of the category of representations of @7(X) in terms of sheaves on its 
Lagrangian skeleton. Some of our results in this paper about DAHA representations 
can thus be interpreted as a particular example of the generalized Riemann-Hilbert 
correspondence. 


1.2 Results 


We first study the representation theory of spherical double affine Hecke algebra SH 
of type A, from the viewpoint of brane quantization in great detail. We explicitly 
identify a compact Lagrangian brane in X = Meat(Cp, SL(2, C)), the moduli space 
of flat SL(2, C)-connections on Cp, for each finite-dimensional irreducible represen- 
tation of SH. In particular, we match objects including the parameter spaces, dimen- 
sions and shortening conditions on both sides. We also study the spaces of derived 
morphisms of the two categories. As a by-product, we find new finite-dimensional 
representations of SH that do not appear in [35]. We see examples in which two 
irreducible branes can form bound states in more than one way, corresponding to 
a higher-dimensional Ext!; these bound states are related to subtleties defining A- 
branes supported on singular submanifolds. Hence, the careful study in Chap. 2 in 
terms of brane quantization provides solid evidence for the following: 


' A related functor of a similar kind is constructed in [27-29]. The constructions there give a 
description of the factorization homology of a particular Ey algebra valued in categories in terms 
of modules. (One may equivalently think of such an algebra as a braided tensor category). Taking 
the braided tensor category to be Rep, GL, and applying the general result to a once-punctured 
torus, one obtains a Morita equivalence between the spherical DAHA of type gI(N, C) and the 
endomorphisms of a generating object of the factorization homology. 
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Claim 1.1 For X = Mya(Cp, SL(2, C)), the functor (1.3) restricts to a derived 
equivalence of the full subcategory of compact Lagrangian A-branes of X and the 
category of finite-dimensional SH -modules. 


We also consider a particular example of a non-compact brane corresponding 
to the polynomial representation of SH studied by Cherednik. In fact, the brane 
perspective suggests straightforward generalizations of this representation. 

While the brane quantization proposal—and thus the physics of the A-model—is 
our starting point, many of the various other types of branes in string theory and 
M-theory, and the guises in which they appear, will have a role to play in this paper. 
As was already emphasized, just for example, in the constructions of [117], the 
moduli space X plays an important role in higher-dimensional gauge theories, which 
allows for an embedding of the physics of A-branes into a richer system. We focus 
on one such construction: M5-branes on a once-punctured torus (or equivalently 
with -deformation orthogonal to M5-branes on a torus) in an appropriate setup of 
M-theory. This construction will provide many new angles to view the structure of 
the category of representations of (spherical) DAHA. 

As such, branes will lead us to a geometric interpretation of previously known facts 
about SH-modules, as well as to new results, not previously known in the representa- 
tion theory literature. It is rather straightforward from the geometry of the target space 
X to identify finite-dimensional SH-modules that carry representations of PSL(2, Z). 
More interestingly, by connecting the M5-brane setup of the 3d/3d correspondence 
to the 2d A-model, we can naturally identify the corresponding PSL(2, Z) repre- 
sentations. Let us recall the fivebrane setup for the 3d/3d correspondence where 
M5-branes are located on S! x D? x M3 with the Q-background. Then, a suitable 
compactification on T? x T° can relate this setup to the 2d A-model described above, 
where the center of D? is associated to Bec and a boundary condition at the boundary 
of D? gives rise to By. 

For various choices of boundary conditions $y, the partition function of 3d 
N =2 theory T[M3] on S! x D? computes the corresponding invariant of the 
3-manifold M3. In some cases, such topological invariants of 3-manifolds can be 
lifted to a 3d TQFT, i.e. can be constructed via cutting-and-gluing. In turn, the alge- 
braic structure underlying a 3d TQFT often can be encoded in a modular tensor 
category (that, in general, may be non-unitary or non-semisimple). In particular, 
in the present setup of 3d/3d correspondence, this algebraic structure itself can be 
viewed as a special case MTC[S! x ($? \ pt), 8] of amore general algebraic struc- 
ture dubbed MTC[ M3] in [76] for its close resemblance to the structure of a modular 
tensor category. We will explain how concrete instances of this algebraic structure 
can be realized via branes in the 2d A-model and the corresponding SH-modules: 


Hom(Bec, By) = K°(MTC) . (1.4) 
In particular, one such boundary condition leads to a TQFT associated to a 4d 


Argyres-Douglas theory. In general, branes supported on M that are invariant under 
PSL(2, Z) action (not pointwise) give rise to interesting PSL(2, Z) representations 


6 1 Introduction 


Hom (Bec, B m), and 3d/3d correspondence can help us to relate them to the modular 
data (and the Grothendieck group) of an MTC-like structure. 

Another relevant brane setting appears in the class S construction [62, 70] of a 4d 
N = 2* theory T[C,] where M5-branes are placed on S! x R? x Cp. An algebra 
of line operators becomes the coordinate ring of the Coulomb branch of 4d VV = 2* 
theory on S! x R? [69], and we can study it again in a rank-one case from the relation 
to SH. As in [6], the spectrum of line operators in the 4d VV = 2* theory is sensitive 
to the global structure of the gauge group, which can be specified by imposing 
additional discrete data. In fact, the Coulomb branch of 4d VV = 2* theory of rank- 
one is given as the quotient of Mga(C,, SL(2, C)) by this additional discrete choice 
Z2 C Z2 ® Z2, which can be interpreted as an automorphism group of SH. Therefore, 
we can study the elliptic fibration of the Coulomb branch, and the algebra of line 
operators on the Q-background is a Z2-invariant subalgebra of SH. Furthermore, by 
introducing a surface operator of codimension two in the system, an algebra of line 
operators on the surface operator is related to the full (rather than spherical) DAHA. 
By compactifying the 4d theory to the 2d sigma-model, we propose a canonical 
coisotropic brane 8,, of higher rank where the algebra of (Bec, Bec)-open strings 
realizes the full DAHA. In this way, the interplay among moduli spaces, algebras of 
line operators, and DAHA can be studied from the viewpoint of the compactification 
of fivebrane systems. 


1.3 Structure 


The structure of the paper follows a simple principle. We start in the world of two- 
dimensional physics, and we gradually proceed to higher-dimensional theories. One 
advantage of this approach is that lower-dimensional theories can be analyzed much 
more explicitly and often can be described in mathematically rigorous terms. For 
example, the two-dimensional sigma-model perspective is phrased in the language 
of the topological A-model, which is reasonably well understood in the mathematical 
literature. Likewise, many explicit calculations can be done easily and many ques- 
tions can be answered more concretely in low-dimensional systems. The advantage 
of higher-dimensional systems, on the other hand, is that they reveal a much richer 
(higher categorical) structure, that helps to see a “bigger picture,” dualities and rela- 
tions between various low-dimensional descriptions, which otherwise might seem 
worlds apart. 

To give a concrete overview of what follows: In Chap.2, we provide a detailed 
study of the equivalence (1.3) between DAHA representations and A-branes. To this 
end, we study the 2d sigma-model on the moduli space of flat SL(2, C)-connections 
(or the Hitchin moduli space) on the punctured torus C, in this section. We begin 
by constructing the spherical DAHA SH in the 2d A-model. We review the rel- 
evant geometry of the target space in Sect.2.1. Then we move on to study the 
algebraic side, reviewing the double affine Hecke algebra of type A; and its spher- 


1.3 Structure 7 


ical subalgebra SH in Sect.2.2. We introduce the canonical coisotropic brane in 
Sect. 2.3, showing how the spherical DAHA SH arises as the algebra of (Bec, Bee)- 
strings. In the remainder of Chap. 2, we discuss the match between representations 
of SH and open-string states between A-branes. To this end, Sect.2.4 reviews some 
details of the category A-Brane, explaining the correspondence between branes sup- 
ported on Lagrangian submanifolds and modules of SH. In particular, we will find 
branes for the polynomial representations in Sect. 2.5. Section 2.6 aims to show the 
match between branes with irreducible compact supports and finite-dimensional SH 
representations. Section2.7 studies bound states of branes and the corresponding 
short exact sequences in representations, matching them between the two categories. 

Some finite-dimensional SH-modules carry PSL(2, Z) representations. Taking 
the 3d/3d correspondence into account, we explore the geometric origin of these 
PSL(2, Z) representations (and the conditions under which they are present) in 
Chap. 3. Moreover, the vantage point of three-dimensional physics reveals additional 
structure concealed behind these PSL(2, Z) representations. We show in Sect. 3.1 
that the fivebrane system of the 3d/3d correspondence connects the two-dimensional 
A-model to three-dimensional topological field theories on a 3-manifold M3. In par- 
ticular, we show that the choice of an SH-module with a PSL(2, Z) action gives 
rise to a modular tensor category that describes such a 3d TQFT on M3, whose 
Grothendieck group is identified with the chosen SH-module. In Sect. 3.2, we pro- 
pose that the categorification of the skein module of a closed oriented 3-manifold M3 
results in a modular tensor category so that there is a “hidden” SL(2, Z) action on 
the skein module of M3. We also explain the connection to SL(2, C) Floer homology 
groups of M3. 

In Chap. 4, we move one more dimension up, and study our category of interest 
from the vantage point of four-dimensional physics, namely in the context of four- 
dimensional M = 2* theories. M = 2* theories can be constructed by wrapping a 
stack of M5 branes on the once-punctured torus C,, labeled with some additional 
discrete data associated to C,. In Sect.4.1, we study an elliptic fibration of the 
Coulomb branch of an M = 2* theory of rank-one on S! x R?, based on the analysis 
of the Hitchin fibration performed in Sect.2.1. We also show that the algebra of 
line operators in the 4d M = 2* theory in the Q-background is a subalgebra of SH 
specified by the discrete data. Here as well, the bird’s-eye view provided by the 
fivebrane system connects 4d physics and 2d sigma-models. We use this in Sect. 4.2 
to sort out the relationships among line operators, Coulomb branches, and DAHA. 
Finally, we introduce a surface operator in the 4d M = 2* theory and consider an 
algebra of line operators on the surface operator in Sect.4.3. We also discuss a 
higher-rank bundle for the canonical coisotropic brane to realize the full DAHA and 
the Morita equivalence Rep(H = Rep(SH ). 

In Appendix A, we list notations and symbols adopted in this paper. A concise 
summary of some basics of DAHA is given in Appendix B. In Appendix C, we 
discuss the representation theory of the quantum torus algebra QT in terms of brane 
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quantization. As a toy model, we show the match between representation theory of 
QT and A-branes on a flat space C* x C*. Then we consider an orbifold quotient 
by Z2, and we match A-branes to representations in this context in Appendix C.3. 
Appendix D is devoted to studying the relation between trigonometric and rational 
degenerations of the spherical DAHA and Coulomb branches of 3d V = 4 theories. 
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Chapter 2 R) 
2d Sigma-Models and DAHA ciecie; 


In this section, we study representation theory of DAHA, strictly speaking, the 
spherical subalgebra of DAHA of type A4, in terms of brane quantization in the 2d 
A-model [85] on the moduli space of flat SL(2, C)-connections on a once-punctured 
torus. The brane quantization lends itself well to a geometric approach to repre- 
sentation theory of spherical DAHA, which provides novel viewpoints. The main 
goal of this section is to explicitly show the correspondence between A-branes with 
compact Lagrangian submanifolds and finite-dimensional representations of spher- 
ical DAHA with respect to dimensions, shortening conditions and morphisms. This 
matching enables us to find new finite-dimensional representations. The geomet- 
ric picture also allows us to identify PSL(2, Z) actions on some finite-dimensional 
modules. As another advantage, we generalize Cherednik’s polynomial represen- 
tation from a geometric viewpoint. These results play a crucial role in higher- 
dimensional physical theories and categorical structures in the subsequent sections. 
DAHA associated to a root system R (or, equivalently, to a semisimple Lie alge- 
bra g) can be constructed by beginning with the quantum torus algebra QT (P @ 
PY, w) defined on the direct sum of the weight and coweight lattices of g with the 
symplectic pairing w between P and PY. More concretely, QT (P © PY, w) can be 
understood as the group algebra of the Heisenberg group with the relation 


X"Y` =q HNY>`X", for peP,AcP“, 


where (u, A) is the symplectic pairing. Note that this lattice is isomorphic to the 
standard pairing on Z? #™P = Z?” so that the algebra has outer automorphism group 
Out(QT(P @ PY, w)) = Sp(2n, Z). 

However, we have the additional data of the action of the Weyl group W on P 
and PY. This gives a distinguished embedding of W into Sp(2n, Z), which therefore 
determines an extension 


0 > OTP P“, w) > FA,=1(W) > C[W] > 0 (2.1) 
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up to equivalence. The algebra, Ë,- (W) is known to be the group algebra of the 
double affine Weyl group W: H,=ı(W) = C[W]. Since the representation of W is 
just on P (and contragredient on P“), this extension leaves the “diagonal” Sp(2, Z) 
subgroup unbroken as outer automorphisms of Ë,- ı(W). For the Cartan type Aj, 
this construction is equivalent to the algebra Ë, in Appendix C.3. Moreover, the 
algebra Ë, (W) can be further deformed by other formal parameters f, transform- 
ing the group algebra C[W] to the Hecke algebra. The result is DAHA H(W). We 
will give a concrete description of the deformation in the Cartan type Aj, in this 
section. DAHAs of general Cartan types are explained in Appendix B. Through 
this construction, the quantum torus algebra and DAHA are closely related, and we 
can take the same approach to representation theory of the quantum torus algebra. 
Although the representation theory of the quantum torus algebra is well-known, it 
can be a useful guide for DAHA. Therefore, the reader can refer to Appendix C 
for the brane quantization of the quantum torus algebra and symmetrized quantum 
torus. 

The algebra fat (W) is not commutative, even in the q = 1 limit. Nonetheless, it 
contains the spherical subalgebra SH (W), obtained by an idempotent projection, 
which is commutative as q = 1. In the limit t = 1, SH,~;(W) is isomorphic to the 
Weyl-invariant subalgebra of OT (P @ PY, w) (after a lift of the Weyl group action 
is chosen). In the further specialization g = 1, SH becomes precisely the algebra of 
Weyl-invariant functions on 


(tc/Q”) x (t¢/Q) = Te x Te. 


Note that we take the coroot and root lattices QY 6 Q = Hom(P, Z) @ Hom(PY, Z) 
(namely the dual lattice) as the quotient lattice. This space with group action is 
nothing other than the moduli space of flat connections on a two-torus T?, valued in 
the corresponding complex Lie group Gc: 


Maa(T?, Gc) = Hom(m™ (T°), Ge)/Ge 
~ Ic x Te (2.2) 
= ae 

We would like to consider an additional deformation of this moduli space to 
study the representation theory of spherical DAHA geometrically. Happily, for type 
A, this can be achieved just by adding a “puncture” on a two-torus T. Despite this 
rather simple “addition”, the story becomes incredibly deeper and more interesting. 
This section focuses on DAHA of rank one to illustrate and highlight all the delicate 
features and interesting phenomena. In rank one, we can perform concrete compu- 
tations as explicitly as possible. For that reason, we will first review some necessary 
background on the moduli space of flat SL(2, C)-connections on a once-punctured 
torus, which will play the role of the target space X in the 2d sigma-model. 
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Then, we will carve out A-branes in X for salient modules of the spherical DAHA. 
This will give solid evidence of the functor (1.3) from the categories of A-branes in 
X to the representation category of the spherical DAHA. 


2.1 Higgs Bundles and Flat Connections 


Figuratively speaking, the target space of the 2d sigma-model is the stage where our 
main characters (branes) will make their appearance. Thus, let us begin by setting 
the stage. 

The target space of our system will be the moduli space of G = SU(2) Higgs 
bundles on a genus-one curve C,,, ramified at one point p: 


£ := My (Cp, G). (2.3) 


Although the geometry of this space, also called the Hitchin moduli space, is a fairly 
familiar character in mathematical physics literature, we review those aspects that 
will be especially important for applications to DAHA representations. 

Recall [94, 138], that a ramified (or stable parabolic) Higgs bundle is a pair 
(E, p) of a holomorphic SU(2)-bundle E over a curve C and a holomorphic section 
y, called the Higgs field, of the bundle Kc ® ad(E) ® O(p). Here, Kc denotes the 
canonical bundle of C, and O(p) is the line bundle whose holomorphic sections are 
functions holomorphic away from p with a first-order pole at p. The ramification 
at p—more precisely called tame ramification since we are considering first-order 
pole—is described by the following conditions on the connection A on E and the 
Higgs field 

A=Qapdů +... 
1 d 2.4 
= 5B tit a 
Here, z = re!” is a local coordinate on a small disk centered at p, and the rami- 
fication data is a triple of continuous parameters, (ap, Bp, Yp) E€ T x t x t where 
we denote the Cartan subgroup T C G and the Cartan subalgebra t C g. With this 
prescribed behavior at p, the Hitchin moduli space is the space of solutions to the 
equations 
ioc (2.5) 
Dap =0, 
modulo gauge transformations. We denote this moduli space M (Cp, G), where 
Cp is a Riemann surface C with the tame ramification (2.4) at p € C. It is a hyper- 
Kahler space and the corresponding Kahler forms are 
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vra ->f |d?°z]| T(z A A; — OD A õp) 
2m C 


1 
mes f \d?2| Te(5p ASA, + 5p A 642), (2.6) 
2m C 


ife - 2 l 
wK = 5 [i z| Tr(5p A 5A, Sip A Az) . 


T 


There is also a triplet of holomorphic symplectic forms Q; = wy + iwgp, Qj = 
wg + iwz, and Qg = wz + iwz, holomorphic in complex structures J, J, and K, 
respectively. In the absence of ramification, it is easy to check that w; and wx are 
cohomologically trivial [117, Sect. 4.1], whereas wz is non-trivial and, if properly 
normalized, can be taken as a generator of H 2(%, Z). On the other hand, in the pres- 
ence of ramification (2.4), the cohomology classes of wy; and wx are proportional to 
bp and yp, respectively. 

The description of M(Cp, G) as the moduli space of Higgs bundles given 
above is in complex structure 7. Another useful description, in complex structure 
J, comes from identifying a complex combination Ac = A + i¢ with a Gc-valued 
connection, where ¢ = p + ¢. The Hitchin equations then become the flatness con- 
dition Fc = dAc + Ac A Ac = 0 for this Ge-valued connection Ac. According to 
(2.4), it has a non-trivial monodromy around the point p: 


U =exp(27(Yp + iap)) . (2.7) 


which depends holomorphically on y, + ia, and is independent of (,. Indeed, in 
complex structure J, 3, is a Kahler parameter and y, + ia, is a complex structure 
parameter. Another useful fact, also explained in [84], is that the cohomology class 
of the holomorphic symplectic form Qj; = wx + iwr is proportional to yp + iap 
and independent of /3,. 

Similarly, in complex structure 7 the Kahler modulus is ap, while 3, + i7p is a 
complex structure parameter. The cohomology class of the holomorphic symplectic 
form Q; = wy + iwx is Bp + iyp. There is a similar story for complex structure K 
and all these statements are summarized in Table 2.1. 

In a supersymmetric sigma-model with target X, the Kahler modulus of the target 
space is always complexified. This fact plays an important role in mirror symmetry. 
In the present setup, too, the Kahler moduli are all complexified by the periods of 
the 2-form field B. For example, in complex structure 7, the complexified Kahler 


Table 2.1 Complex and Kahler moduli of the moduli space M y with one ramification point 


Complex structure Complex modulus Kahler modulus 
I By +iyp ap 
J Yp +i Ap Bp 
K Ap +i Bp Yp 
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modulus is a, + inp, where 7, € TY = Hom(AY, U(1)) and AY is the cocharac- 
ter lattice of G. Therefore, taking into account the “quantum” parameter np, the 
ramification data consists of the quadruple of parameters (a, Bp, Yp» Np)- 

All of these structures can be made completely explicit in the case when C, is 
a punctured torus. In complex structure J, where X = M p (Cp, G) is the moduli 
space of complex flat connections on Cp, we can then use an explicit presentation 
of the fundamental group 


m(Cp) = (m, L, clmim T! = c). (2.8) 


to describe flat connections concretely, in terms of holonomies along the (1, 0)-cycle 
m, the (0, 1)-cycle [, and the loop ¢ around p: 


x =Tr(p(m)), y = Tr(p(), and z = Tr(p(mt"!)) . (2.9) 


In terms of these holonomy variables, the space of SL(2, C)-representations p : 
™1(Cp) —> SL(2, C) is a cubic surface (see e.g. [72, 82]): 


Maat(Cp, SL, C)) = {@, y, 2) € Clx? +y? + 2? — xyz -2 = Trp) =P? +777}. 

(2.10) 
Here we used the fact that, according to (2.7), the holonomy of the complex flat 
connection around p is conjugate to 


raw) 
PORS p 2) , (2.11) 


This section will be devoted to studying the deformation quantization G4 (X) of this 
coordinate ring holomorphic in complex structure J, which is generated by x, y, z, 
and its representations geometrically. 

For a complex surface defined by the zero locus of a polynomial f(x, y, z), the 
holomorphic symplectic form (a.k.a. Atiyah-Bott-Goldman symplectic form) can be 


written as 
1 dxAdy _ 1 dxAdy 


= = : 2A2 
2ri Of /Oz 2ri 2z — xy ise 


J 
and the Kähler form is 
wJ = pa (dx Adi + dy Adj + dz ^ d3) . (2.13) 
T 


In the special case œp, = p= %ŅYp=0, the moduli space of flat 
SL(2, C)-connections on C, is simply a quotient space 


(C* x C*)/Zy (2.14) 
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by the Weyl group Zz. It can be understood as a moduli space of flat SL(2, C)- 
connections on a torus (without ramification), such that holonomy eigenvalues along 
A- and B-cycles each parametrize a copy of C*. The “real slice” (S! x S!)/Zy 
is the moduli space of SU(2) flat connections on the (punctured) torus, and it is 
sometimes called the “pillowcase”. According to the theorem of [128] (resp. [125]), 
it can be identified with the moduli space Bun(C,, G) of stable (resp. parabolic) G- 
bundles on Cp. It is easy to see that Bun(C,, G) is a holomorphic submanifold of 
Mzy(C,, G) in complex structure 7. Furthermore, because ôy = 0 on Bun(C,, G), 
it follows from (2.6) that Bun(C,, G) is a holomorphic Lagrangian submanifold 
with respect to Q, (in particular, Lagrangian with respect to wy and wg ). Following 
the notation in Sect. 2.4, we write it by V as a Lagrangian submanifold in the target 
(X, wx). 

In addition to V, other special submanifolds of M y (Cp, G) will play a role in 
what follows. For example, in complex structure J, the Hitchin moduli space is a 
completely integrable Hamiltonian system [94], i.e. a fibration 


a: My(Cp, G) > Bu (2.15) 


over an affine space, the “Hitchin base” By, whose generic fibers are abelian vari- 
eties (sometimes called “Liouville tori”). For G = SU(2), the map 7 takes a pair 
(E, p) to Try”, which is holomorphic in complex structure 7. Specializing fur- 
ther to the case where C, is a genus-one curve gives a particularly simple inte- 
grable system: its generic fiber F is a torus that, just like V, is holomorphic in com- 
plex structure J and Lagrangian with respect to wy and wx. We also note that the 
only singular fiber of the Hitchin fibration 7: M y (Cp, G) —> By is the pre-image 
N = m~! (0) of 0 € By which, in the limit Qp = Bp = Yp = 9, is the “pillowcase” 
V = (S! x S!)/Z> with four orbifold points. 

Now let us consider what happens when we go away from the limit a, = 8) = 
Yp = 0 and consider generic values of the ramification parameters. From the view- 
point of the complex structure J, the equation (2.10) describes the deformation of 
the four A; singularities of the singular surface (2.14), where 7* (or, equivalently, 
Yp + i@,) plays the role of the complex structure deformation. On the other hand, 
turning on 8, Æ 0 leads to a resolution of the A,-singularities. In other words, 3, 
is the Kahler structure parameter in complex structure J, cf. Table 2.1. 

Recall that a, is the Kahler structure parameter in complex structure J. If we 
turn on a, while keeping p = Yp = 0, then the four orbifold points are blown 
up in the Hitchin fibration. Consequently, the singular fiber in the Hitchin fibration, 
called the global nilpotent cone N := 7~'(0), now contains five compact irreducible 
components (all rational) [82, 90]: 


4 
N=VU\JD; . (2.16) 


i=1 
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Fig. 2.1 Schematic illustration of the Hitchin fibration M y (Cp, SU(2)) + By and global nilpo- 
tent cone at 3, = 0 = 7p and a generic value of a œp 


In fact, it is a singular fiber of Kodaira type 7; [108, 109] in the elliptic fibration 7. 
The irreducible components V and D; of the global nilpotent cone are holomorphic 
Lagrangians with respect to 27, sometimes called Lagrangians of type (B, A, A). 
The homology classes of V and D; provide a basis for the second homology groups 
Hy(My (Cp, G), Z), and their intersection form is the affine Cartan matrix of type 
Da, as illustrated in Fig. 2.1. The intersection form has only one null vector, which 
must be identified with the class of a generic fiber F of the Hitchin fibration, result- 
ing in the relation 


4 
[F] = 2[V] + XID . (2.17) 
i=l 


Once we move away from 3, = Yp = 0, we are deforming the complex struc- 
ture modulus 3, + iy, of complex structure 7, and so the structure of the Hitchin 
fibration drastically changes. For generic values of (3,, Yp), the embeddings of the 
two-cycles V and D; (i = 1,..., 4) into My(C,, G) are no longer holomorphic 
with respect to complex structure J, and the singular fiber of type Jj splits into 
three singular fibers of type J2 [61, Sect. 3.4]. If we write the base genus-one curve 
Cp of the Hitchin system by an algebraic equation y? = (x — e1)(x — en) (x — e3) 
with e; + e2 + e3 = O where the ramification point p is located at infinity, then the 
singular fibers of type J, are preimages of points 


By > bi := e&iTr (8p tip? G=1,2,3), (2.18) 


under the Hitchin fibration as depicted in Fig. 2.2. In the singular fiber at b; € By, 
two irreducible components U>;_; and U>;, which are topologically CP!, meet at 
two double points. 

Hence, the two-cycles V and D; (i = 1,..., 4) are not projected to a point by 
the Hitchin fibration with a generic ramification, though they still give a basis of 
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Bu 


Fig. 2.2 The Hitchin fibration with a generic ramification contains three singular fibers of Kodaira 
type Jp at the base points b; (i = 1, 2, 3) 


Hy(My(Cp, G), Z) and satisfy the relation (2.17). An analysis by the Mayer- 
Vietoris sequence tells us that the homology class of each irreducible component 
in a singular fiber J) can be expressed as 


[U1] = [V] + [D1] + [D2], [U3] = [V] + [D1] + [D3], [Us] = [V] + [D1] + [D4] , 
[U2] = [V] + [D3] + [D4], [U4] = [V] + [D2] + [D4], [U6] = [V] + [D2] + [D3] , 

(2.19) 
and there is another two-cycle W as in Fig. 2.2 with homology class [W] = [D,]. 
With respect to the new basis 


[U1], [U2], [U3], [Us], [W] € H2(Ma (Cp, G), Z) , (2.20) 


the intersection form becomes 


2 —200 1 
-2 2 00-1 
00201]. (2.21) 
0 0021 
1 -111 2 


Note that the upper-left two-by-two matrix is the Cartan matrix of the affine type A 1 
as the intersection form of a singular fiber of type h. 
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For our applications to branes and representations, we also need to know the type 
of the five compact two-cycles V, D; (i = 1, ..., 4) and periods of the Kahler forms 
over them. The integrals of 82; over V and over F were computed e.g. in [82]. They 
can be expressed as the following set of relations: 


WI 1 . 
ma eh diag(X,, Xp) ~ ap ET, 
WJ : $ 
| i. —sign(a,)Bp,  diag(Bp, —Bp) ~ Bp Et, (2.22) 
y T 
WK : : 
z = =sign(&p)Yp , diag(Yp, —Yp) ~ Wp Et 
y T 
and 
A aj |. (2.23) 
F 2m F 2m F Qn 


where in the latter we used the fact that the Hitchin fiber F is holomorphic in com- 
plex structure 7 and Lagrangian with respect to Q; for any (ap, Bp, Yp). We assume 
that «, takes its value in the range —5 < Xp L 5. Although we did not compute the 
periods of the 2-forms (2.12) and (2.13) over exceptional divisors D; directly, we 
claim 


|Xp| Wy] : Bp Wy 3 Yp WK 
SO ho A Sa A = oe 
(2.24) 


independently of i = 1, 2, 3, 4. One way to justify this claim is to compute the peri- 
ods for small values of y, + ia, © 0, i.e. for t © 1. Another way is to use (2.17) 
together with the symmetries of M y (Cp, G) that we discuss next. The formulae 
above are compatible with the fact that the Weyl group symmetry of the ramifica- 
tion parameters given by an overall sign change 


(Xp, Bp, Yp) > ( Xp, Bp, Yp) (2.25) 


leaves the moduli space completely invariant. 
Furthermore, the “quantum” parameter that complexifies a Kahler parameter can 
be understood as the period of the B-field in a 2d sigma-model over D; 


. B . 
sign(Xp)Np = f an? diag (np, —Np) ~ Np €& T“. (2.26) 
D; 4T 


In the following, we often use the parameters (œp, Bp, Yp, Np) € S! xRxRx sS! 
and the quadruple (ap, 8p, Yp Mp) ET xX tx tx T“ of the tame ramification (2.4) 
at p € C in the same meaning. 
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Symmetries 


The target space (2.3) of our sigma-model has the symmetry group! 
2 x MCG(C,) = Z2 x Z2 x SL(2, Z) (2.27) 


where & = Z3 x Zz is the group of “sign changes” generated by twists of a Higgs 
bundle E — C, by line bundles of order 2. Abusing notation, this group can be 
identified with H'(C, Z2) = Z2 ® Z3 where Z, is the center of SU(2). Obviously, 
SL(2, Z) is the mapping class of the (punctured) torus: 


MCG(C,) = SL(2, Z) . (2.28) 


Both & and MCG(C,) are symmetries in all complex and symplectic structures. In 
particular, in what follows, we will need their explicit presentations as holomorphic 
symplectomorphisms with respect to Qy. 

In complex structure J, the “sign changes” & = Z2 x Zp are holomorphic invo- 
lutions, and its generators €), €2 and their combination £3 := £ o & act as 


é: (x, y, z) œ> (=x, y, —2) , 
fo: (x,y,z) (x, —y, —z), (2.29) 
&: (x, y,Z) > (—x, —y, Zz), 


respectively. The “sign changes” symmetry plays a very important role to under- 
stand mirror symmetry [82] and connections to 4d physics in Sect. 4. 

The symmetry group & leaves V invariant (as a set, not pointwise) and acts on 
the exceptional divisors D; as follows: 


£::D,;<D. and DoD, 
&:D,;<—D; and DoD, (2.30) 
é : Dı < D4 and D; <e D}. 


This symmetry, illustrated in Fig. 2.1, provides supporting evidence to our assump- 
tion in (2.24). 

In complex structure 7, a point in the Hitchin base By is invariant under & so that 
it acts on each fiber as translations of order two in the Hitchin fibration M y > By 
[61, §3.5]. It acts freely on a generic fiber. On the other hand, £; acts on each irre- 
ducible component of the singular fiber am! (b;), namely U>;_; and U2,;, respectively, 
where the fixed points are exactly the two double points. At the other singular fibers, 
it exchanges the two double points and swaps the two irreducible components 


' The symmetry of the A-model can be larger or smaller than the group of geometric symmetries. It 
can be larger due to quantum symmetries not directly visible from geometry, and it can be smaller 
if some geometric symmetries are Q-exact from the A-model viewpoint. 


2.1 Higgs Bundles and Flat Connections 19 
éi: Uni41 <> Uz2 and Unj43 <> Uzi44 , (2.31) 


where the indices of U are counted modulo 6. This is consistent with the homology 
classes (2.19) and the actions (2.30). 

The action of SL(2, Z) on the eigenvalues of the holonomies p(m) and p(Ù is 
indeed given in (C.30). In particular, the non-trivial central element —1 of SL(2, Z) 
indeed exchanges the eigenvalues of the holonomies p(m) and p(Ù as well as the 
one around the puncture (2.11) to their inverses. Therefore, it acts as the Weyl 
group symmetry of SL(2, C). Subsequently, the trace coordinates x, y, z are invari- 
ant under the non-trivial central element —1 so that SL(2, Z) acts projectively on 
the coordinate ring Ó (X) holomorphic in complex structure J. However, the eigen- 
values of the holonomy around the puncture are exchanged, which we denote 


titr (2.32) 


A quotient of MCG(C,) = SL(2, Z) by the center is PSL(2, Z) = SL(2, Z)/ + 1, 
which is the mapping class group of a 4-punctured sphere. In order to find an explicit 
presentation of PSL(2, Z), it is convenient to note that T? — S? is a double cover 
branched at 4 points, cf. (2.14) 


PSL(Q, Z) = Br3 /Z (2.33) 
where the second equality is a well-known relation to the Artin braid group Br3. In 


terms of standard generators 7, and 7~!, which satisfy the braid relation T} TZ !T} = 


T_'t,72', the center Z of Br; is generated by (r,7~')*. Under the surjective map 


onto PSL(2, Z), we have p 


TL (i 1) i TR ¢ T (2.34) 


7 7 0-1 z 1-1 
o := TAT Ty = TZT! b> ¢ 0 ) ’ TT! > (; a $ (2.35) 


and 


In the quotient (2.33), the latter two elements have order 2 and 3, respectively. 

Using (2.33), we can relate our present problem to the mapping class group action 
on the character variety of the 4-punctured sphere? which is also a cubic surface of 
the form (2.10) and on various branes (submanifolds) on this surface [81]: 


2 In the notations of [81] we need to take (x1, x2, x3) = (—x, y, —z), 0) = 02 = 63 = 0, and 
b, =-2 -P —7f-”. 
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T4: (X,Y, Z) (x,xy—z, y), 
T-: (x,y,z) y- z, y, x), (2.36) 
o: (x,y,z) (y, x, xy- z). 


It is easy to verify that these are indeed polynomial automorphisms of the cubic 
surface (2.10) and that they satisfy the braid relation. 

Note, the action of PSL(2, Z) leaves V invariant (as a set, not pointwise) and acts 
on the exceptional divisors D; as on the set of Z3 torsion points on an elliptic curve, 
In other words, D; is fixed by the PSL(2, Z), also as a set, not pointwise, whereas 


D2, D; and D; transform as points 5, 3, and 5 + 2: respectively. In terms of the 


generators of PSL(2, Z), we have explicit transformation rules 


T4 : D2 < D4 and D, D; arefixed as a set, 
T- : D; <> D4 and Dı, Do are fixed as a set, (2.37) 
o : D2 < D} and Dı, D; are fixed as a set. 


In addition, these generators permute the singular fibers of type J in the Hitchin 
fibration as 63: 


T- 5 ab) —— T! (b) BO 
= (2.38) 
In the above, we pointed out that V is invariant under both symmetries & and 
PSL(2, Z) only as a set, not pointwise. Also, the same is true about PSL(2, Z) action 
on D;. While in the case of V the reason for both claims is fairly clear (e.g. it is 
manifest in the f > 1 limit (2.14)), the fact that PSL(2, Z) fixes Dı only as a set 
and not pointwise is less obvious. In order to explain it, let us consider the limit 
f = l + €, with e < 1, and take (x, y, z) = (2+a,2+b,2+c). Then, for small 
values of (a, b, c), the surface (2.10) looks like a quadric 


a’ +b +c? — 2(ab + be + ca) = 4e, 


on which the generators T+ act as linear reparametrizations: 


T4 : (a,b,c) (a, 2a+2b—c,b), 
T_: (a,b,c) Qa+2b—c,b,a). 
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Fig. 2.3 Generators and relations in the orbifold fundamental group of the once-punctured torus. 
On the left, generators and relations are drawn on the double cover. The relations depicted are 
TXT =X TY T= mdi y YT =l 


2.2 DAHA of Rank One and Its Spherical Algebra 


Now let us review a few necessary details of DAHA of rank one here. Much like the 
Hecke algebra sits, loosely speaking, between the Weyl group and the braid group— 
in the sense that the latter two can be obtained by either specialization or by omitting 
some of the relations—DAHA sits in between the double affine Weyl group and the 
double affine braid group. This perspective, reviewed in e.g. [83], will be useful 
to us in what follows. In Cartan type Aj, the double affine braid group (a.k.a. the 
elliptic braid group), denoted Brg=1 (Z2), is simply the orbifold fundamental group 
of the quotient space (T?\ p)/Z2, the quotient of a once-punctured torus by Zz. It is 
generated by three generators X, Y, and T, illustrated in Fig. 2.3: 


nt ((1?\ p)/Z2) = (7. X,YITXT=X!, TYT =Y, 7 ses 1) . (2.39) 


Its central extension, denoted Br(Z»), is obtained by deforming the last relation to 
Y-IXIYXT? 9". 

Then, rank-one DAHA H (Zz) is obtained by imposing one more quadratic 
(“Hecke”) relation: 


. TXT=X"'!, YX lyxrP=q', 
H (Z2) = Cg AT X+! Y 3y] a a ee | . (2.40) 


This involves the second deformation parameter t. Here C4, is a ring of coefficients 


defined as follows. Let C[q 2 ‘ 
1/2 


SI 
~ 


] be the ring of Laurent polynomials in the formal 
parameters qg’/~ and t, and consider a multiplicative system M in C[q z, t~] gener- 
ated by elements of the form (g‘t — q~t~') for any non-negative integer £ € Zs. 
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We define the coefficient ring C,,; to be the localization (or formal “fraction”)? of 
the ring C[g 2 t Jat M: 


1 


Cq = M-'C[q*2, t*]. (2.41) 


This coefficient ring contains the two central generators of the algebra H (Z2), 
q and t, which can be thought of as continuous deformation parameters and start 
life (in any irreducible representation) as arbitrary complex numbers. Many remark- 
able things happen when these two parameters assume special values, as will be 
further discussed in the sequel. In a way, the behavior of the algebra and its repre- 
sentations under such specializations—and the match of this behavior to the A-brane 
category—is one of the most interesting aspects of the geometric/physical approach. 

Another standard notation for the second deformation parameter (which is con- 
venient for some of the specializations) is 


t=q°. (2.42) 


where c is often called the “central charge”. In what follows, we will use the short- 
hand notation H = H (Z2) unless we wish to make a statement about DAHA of 
Cartan type other than Aj. 

For further details and properties of DAHA, we refer the reader to the fundamen- 
tal book [35]. The representation theory of DAHA there will be introduced through- 
out this section, as they emerge from physics and geometry. Also, some basics of 
DAHA are assembled in Appendix B. 

The construction of H based on the punctured torus allows us to see the action of 
the symmetry group (2.27), and the symmetry plays a pivotal role in the geometric 
understanding of the representation theory of (spherical) DAHA in what follows. 
Under &, the generators are transformed as 


&:TRT,XP-X, YRY, qegqtet, 
H:TRT, Xe X, YR-Y,qrg,trt. 


(2.43) 


The mapping class group SL(2, Z) acts on the generators of H as follows*: 


: : F PORNE 1 
3 In other words, C,,; is the ring of rational functions in the formal parameters q2 and t where 
denominators are always elements in the multiplicative system M such as 


P(X) 
(Yogi — gH Ga gk | 


N= 
~ 


f(X) € Clq X]. 


a Although we follow the notation of [35] for the transformations T+ on the generators of DAHA 
here and in (B.8), we change matrix assignments to T+ as in (2.34) and (B.10) from [35] since it is 
consistent with the projective action (2.37) of SL(2, Z) on the exceptional divisors geometrically. 
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Th: (X,Y,T) (X,q°?XY,T) 
tT: (X,Y,T) (q2YX,Y,T) (2.44) 
o: CLE T) YO" XT?, T) 

Since ø essentially exchanges the canonically conjugate variables X and Y, it is 


sometimes called the Fourier transform of H. Also, H enjoys the following (non- 
inner) involution, 


:T= -T, XPxX, YRY, qrgq, trer!. (2.45) 


It is easy to check from the Hecke relation that e = (T + t7')/ Q +t!) is an 
idempotent element (e? = e) of H. Then, the spherical subalgebra SH is defined by 
the idempotent projection 2 ` 

SH := eHe. (2.46) 


The generators of SH can be identified with 


x=(14+?r)eXe=(X+ X7 e (2.47) 
y= (1 +t°)eYe = (Y + Y`!)e (2.48) 
z= (q 2Y7'X +q X7'Y)e = e, (2.49) 
(q~ =) 
and they satisfy relations 

[x, yl = (q7! — q)z 

Ly, zla = (q7 — q)x 
á aj (2.50) 

[z, X]q = (q ~ q)y 


it al ie 1 <2: 
q ix tay tq? —qixyz=(qit—qt'y+@it+q?y, 


2nih 


where q = e and the g-commutator is defined by 


la, bly := q-2ab = qiba ‘ 


See e.g. [142] for further details. The key point is that the spherical DAHA SH is 
commutative at the “classical” limit q = 1 while the DAHA A is not commutative 
even in the q = | limit. Indeed, it is easy to see that in the “classical” limit q > 
1, the Casimir relation (the last one) in (2.50) becomes the equation for the cubic 
surface (2.10): © 

SH ai O (Maa (Cp, SL(2, C))) . (2.51) 
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Thus, SH is the deformation quantization Â% (Æ) of the coordinate ring (2.10) of the 
moduli space of flat SL(2, C)-connections X = Mfa(Cp, SL(2, C)) with respect to 
the Poisson bracket defined by 2; [130, 131]. 

Here, it is worth commenting on an important issue in the context of the defor- 
mation quantization of the coordinate ring on the affine cubic hypersurface of the 
form (2.10). It is clear that this equation is Weyl-group invariant, so that the mon- 
odromy parameter f appears only through the symmetric combination ¢ + 7~!, and 
that the same symmetry applies to the Poisson structure. Moreover, if we work with 
a specific value of f, we will obtain the deformation quantization at a specific value 
of the parameters, i.e. for a specific choice of the central character (at least for the 
formal parameter t). 

Since the inputs to deformation quantization depend on f only in a Z»-invariant 
fashion, the output @7(X;) will also have the corresponding symmetry. However, 
this clarifies that f Æ t, since the relations (2.50) do not depend symmetrically on t. 
The proper identification is 


T=, (2.52) 


= 


as will be made clear by the discussion of the formal outer automorphism z below. 
There is no contradiction with the statement that SH is the deformation quantization 
of G(X), since the classical limit of SH still recovers the same commutative Poisson 
algebra. 

It is simple to check that the two involutions (2.43) straightforwardly reduce to 
the symmetry of SH, which is the same as (2.29). As in the classical case, the non- 
trivial central element —1 € SL(2, Z) acts trivially on the generators of SH , and the 
action of PSL(2, Z) is quantized from (2.36) 


T}: (x,y,z) => (x AISA Z y) 
+: EY ’ ’ ’ 
gil2 4+ q7! 


xy + yx 
T-: (x,y,z) > ( zyx) ; (2.53) 
gi? + q7"/2 
o: (yz) (yx, 2 3) 
mad 7? gl 4 g-l2 


m 


Thus, the symmetries & x PSL(2, Z) can be seen in outer automorphisms of SH. 
The other outer automorphism 7 in (2.45) is somewhat more complicated; it does 
not preserve the idempotent, but it rather brings it into the other idempotent element 


~l 
ll 
y 
l 
ll 


(2.54) 


Thus, ¿ maps SH to the other spherical subalgebra €HE where the Casimir relations 
are different by t <> t~'. However, the involution 7 on H does correspond in a sense 
to an outer automorphism of SH, which acts simply by 
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Lite qt!. (2.55) 


Indeed, it is easy to check that this map preserves the Casimir relation in (2.50). 
(Note that this automorphism only acts nontrivially when q and t are regarded as 
formal elements; it does not preserve the central character.) 

In general, we are free to think of any commutative algebra as the coordinate 
ring of a certain affine space. In addition to the example above, we consider the 
case of X = C* x C* for the quantum torus algebra in Appendix C, and X as 3d 
N = 4 Coulomb branches in Appendix D in this paper. What is common between 
all of these examples are certain key properties of X: First of all, it will always 
be a non-compact manifold, so that it has a large and interesting algebra O(X) of 
holomorphic functions with polynomial growth at infinity. (In fact, in this paper, X 
will always be an affine variety over C.) It will also be a hyper-Kahler manifold, and 
an algebra is obtained by the deformation quantization of the coordinate ring of X 
with respect to a certain holomorphic symplectic form. These conditions fit into the 
context of brane quantization [85] in a 2d sigma-model. It is the central idea of this 
paper, and this will pave the way towards a geometric angle on the representation 
theory of SH. 


2.3 Canonical Coisotropic Branes in A-models 


Here, we will obtain the deformation quantization of the coordinate ring of X with 
respect to Q; by using the 2d A-model on a symplectic manifold (X, wx). The main 
character in our story is the canonical coisotropic brane, denoted Bec. Eventually, 
we will investigate the representation theory of SH by the 2d A-model, but we begin 
by constructing the (presumably less familiar) canonical coisotropic brane Bec here. 
Subsequently, we will discuss standard Lagrangian branes and some methods for 
computing spaces of morphisms in what follows. Our review is necessarily cursory; 
for more details, we refer to the literature [82, 85]. 

In general, as was pointed out in [107], the A-model admits branes with sup- 
port on coisotropic submanifolds which are equipped with a transverse holomorphic 
structure. The canonical coisotropic brane is supported on the target space X itself, 
which is a coisotropic submanifold of the target space X in a rather trivial way. More 
precisely, there is a family of such branes, labeled by a complex parameter 


h=|hle® , (2.56) 


and we will identify it with the parameter of deformation quantizations by g = 
e’"ih The fact that the support involves no additional choice is (at least part of) 
the reason for the term “canonical.” On a 2n-dimensional target space, coisotropic 
branes can therefore be supported in dimension n + 2j for integer j; when n is even, 
there can be branes supported throughout the entire target. In our example, n = 2, 
so that no other coisotropic branes can occur just for dimension reasons. 
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In complex structure Z = I cos 0 — K sin 0, the data defining the brane Bec is 
simply a holomorphic line bundle £ —> X, equipped with a connection whose cur- 
vature F is of course equal to the first Chern class: 


Bo: | c\(L) = [F/27] € H?(&, Z). (2.57) 
x 


As usual, open strings ending on Be: source the gauge-invariant combination F + 
B, where 
B € H*(X, U(A)) (2.58) 


is the 2-form B-field. For our family of the canonical coisotropic branes Bec 
parametrized by A on a symplectic manifold (X, wx), the values of [B/27] € 
H?(, U(1)) and the integral class [F/27] € H 2(X, Z) are determined by the equa- 
tion 


f Qy 
i 
so that at a generic value of A in (2.56) we can write 
1 : 
F + B = Re Q = Ae ; 
1 
we = Im Q = -He sind + wx cos 0) . (2.60) 


Since the hyper-Kähler conditions ensure that J = we (F + B), we have the con- 
dition for Bec to be a coisotropic A-brane [107] 


(WZ (B +F) =J =-1. (2.61) 


In particular, when fis real, wx = wg and Bec is a brane of type (B, A, A), whereas 
for A purely imaginary, wx = wr and Bec is an (A, A, B)-brane. Bec is also called 
“canonical” because its extra data corresponds in this fashion to the holomorphic 
symplectic structure. 

Now comes the key point. Under this circumstance, the space Hom(Bec, Bee) 
of open (Bec, Bec) strings with both ends on the canonical coisotropic brane Bec 
is a non-commutative deformation of the Dolbeault cohomology HO” (£) when 
X is regarded as a complex manifold with J, and we are interested in its zeroth 
degree, namely the space of holomorphic functions. Moreover, for X an affine vari- 
ety, a suitable condition at infinity for a “good A-model” is to allow only func- 
tions of polynomial growth. In the presence of non-trivial background F + B Æ 0, 
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A A 


Fig. 2.4 (Left) Open strings that start and end on the same brane $ form an algebra. (Right) 
Joining a (Bec, Bec)-string with a (Bec, B’)-string leads to another (Bec, B’)-string 


Hom? (Bec, Bee) is therefore the deformation quantization of the coordinate ring on 
X, holomorphic in complex structure J [8, 85]. 

In general, for any brane %, in either the A-model or the B-model, the space of 
open strings states End(S8) forms an algebra. This can be easily understood by con- 
sidering the process of joining open strings, illustrated in Fig. 2.4 (left). However, 
generically, this algebra of (%, ) strings is rather simple and not very interest- 
ing. Even if the brane % is “big enough,” the algebra End(%®) can be interesting, 
but may be hard to identify or relate to more familiar algebras. For example, various 
(B, B, B) branes represented by hyper-holomorphic sheaves in [82] lead to interest- 
ing endomorphism algebras, but apart from some special cases it is hard to recognize 
them in the world of more familiar algebras. What makes the canonical coisotropic 
brane special is that the algebra End(%8,.) can be identified with the deformation 
quantization Ó“ (Æ) of the target manifold X [117]. 


2.3.1 Spherical DAHA as the Algebra of (Bec, Bec)- Strings 


In our example, the target space X = Maa(C,, SL(2, C)) is the moduli space of 
flat SL(2, C)-connections over a punctured torus, which is a hyper-Kéhler mani- 
fold. Then, by construction, the algebra of (Bec, Bec) strings is the deformation 
quantization 04 (X) of the coordinate ring on X with respect to (;, which is the 
spherical DAHA SH. 

The parameter g of SH is identified with h in the data (2.59) of Be via q = 
exp(27ifh). It is worth emphasizing that for a generic value of q € C*, the B-field 
needs to be turned on in the sigma-model. In fact, the target admits the Hitchin 
fibration (2.15) where a generic fiber is a two-torus T?. Since a generic fiber F is 


5 Since we are mainly interested in the zeroth degree of morphism spaces, we will usually omit the 
superscript 0, meaning Hom = Hom? unless it is specified. 
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Lagrangian with respect to wy and wx and it sees only wy, the evaluation of Q in 


(2.59) over F yields 
Q 1 


F 2T ~ h l 

where F + B is responsible for its real part. Because [F/27] € H? (©, Z) is an ele- 
ment of the second integral cohomology class, the B-field needs to be switched on 
unless the real value of 1/f is an integer. Thus, a 2d A-model has to incorporate the 
B-field for a generic value of A, and we will moreover witness that the B-field plays 
a more important role in the subsequent sections. 

The parameter t of SH is related to the ramification parameters of the tar- 
get space. In fact, the monodromy parameter (2.11) around the puncture can be 
expressed by the ramification parameters (2.7) as 


t = exp(—7(Yp +iXp)) . 
Furthermore, (2.52) compares the monodromy parameter f with the central character 


t of SH. Then, it is easy to see from (2.24) that the evaluation of (2.59) on an 
exceptional divisor yields 


1 . Qy Yp tid, 1 
Qn [ Tp par [ Qnih  2ih d ee 


where c is the central charge in (2.42). 

The canonical coisotropic brane enjoys the symmetries & x PSL(2, Z) of the 
target space X analyzed in Sect.2.1, which become the outer automorphisms of 
SH given by (2.29) and (2.53). The symmetry (2.55) of SH is indeed the Weyl 
group symmetry ¢ <> f~! of the monodromy matrix (2.11). In fact, the Weyl group 
symmetry (2.25) of the ramification parameters preserves the target space. Since the 
canonical coisotropic brane is sensitive only to (&p, Yp) or t, the symmetry (2.55) 
of SH is equivalent to the fact that the canonical coisotropic branes supported on X; 
and X;-: related by the Weyl group symmetry give rise to the isomorphic algebra 


End (Bec) X SH = End(u(Bec)) . (2.63) 


2.4 Lagrangian A-Branes and Modules of 64 (Æ) 


Now we lay out the approach to the representation theory of 61 (X) by the 2d A- 
model on (X, wx). This subsection also serves as a lightning review about the cate- 
gory of A-branes. 

The approach to the representation theory of 67% from the 2d A-model arises from 
a simple idea: given an open string boundary condition (or an A-brane) 8’, the space 
of (Bec, B’) open strings forms a vector space. As in the right of Fig. 2.4, a joining 
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of (Bec, Bec) and (Bec, B’) string leads to another (Bec, B’) string. This implies 
that the space of (Bec, B’) strings receives an action of the algebra of (Bec, Bec) 
strings [85]. Namely, other A-branes 8’ on Æ give rise to modules for @4 (Æ): 


01 (X) = Hom(Bec, Bec) 
Q Q (2.64) 
B = Hom(Be, B) 


In our example, supports of other branes 8’ are always Lagrangian submanifolds so 
that we will review Lagrangian A-branes Sy in the next subsection. If the support of 
88’ is a Lagrangian submanifold contained in the fixed point set of an antiholomor- 
phic involution Ç : ¥ —> X with ¢*J = —J, then the corresponding representation 
admits unitarity. 

We now briefly recall a few standard facts about Lagrangian A-branes [56, 57] 
and their mathematical incarnation, the Fukaya category Fuk(X, wx). For more 
detail, the reader is referred to the literature, which is substantial; [7] is a good 
starting point, or [110] for the fundamentals of homological mirror symmetry. 

The Lagrangian Grassmannian, denoted LGr, of a symplectic vector space 
parameterizes the collection of its Lagrangian subspaces. We can obtain a descrip- 
tion of this space by thinking of the standard symplectic vector space (R”, w), 
which can be equipped with a metric via a contractible choice. By the two-of- 
three property, the group preserving both the symplectic and orthogonal structures is 
U(n), which therefore acts on LGr(2n); the subgroup stabilizing a fixed Lagrangian 
subspace is O(n), so that 


LGr(2n) = U(n)/ O(n). (2.65) 
There is furthermore an obvious map 
det? : LGr(2n) > U(1) (2.66) 


which can be shown to induce an isomorphism of fundamental groups. The Maslov 
index [3] of a loop in LGr(2n) is its image under this induced map in mı (U(1)) = Z; 
it is responsible for both obstructions and gradings in the Fukaya category. The 
universal cover LGr(2n) of LGr(2n) thus has deck group Z, and the Maslov index 
of a loop is simply the element of Z that connects the endpoints of a lift to LGr(27). 

Let (X, wx) be a symplectic manifold with zero first Chern class (as is obviously 
the case in our hyper-Kéhler examples). There is a bundle 


LGr(X) > X (2.67) 


whose fiber over x € X is LGr(7,X). (We hope the reader will forgive the mod- 
erately abusive notation.) We can furthermore define a bundle LGr(X), which is a 
covering space of the total space LGr(X), such that the covering map is a bundle 
map and restricts over each fiber to the universal covering map. 
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A Lagrangian subspace L C X comes with an obvious lift 


LGr(X) 


fe | (2.68) 


| —— £ 


defined by the Lagrangian subbundle TL C TX|,. Lifting this canonical map to 
LGr(X) is obstructed by the image of mı (L) under the Maslov map, which is an 
element of H!(L, Z) called the Maslov class. Lagrangians with zero Maslov class 
admit so-called graded lifts, which are maps 


Pa | (2.69) 
L — > & 

making the square commute. The set of such maps is naturally a Z-torsor under the 

action of deck transformations, but no canonical choice of graded lift exists. Given 

a Lagrangian object of A-Brane(X, wx), the set of graded lifts plays the role of its 

shifts. 

A (rank-one) Lagrangian object of A-Brane(X, wx) is supported on a Lagrangian 
submanifold L C X of zero Maslov class, which is considered up to Hamiltonian 
isotopy. The additional data required to define a Lagrangian A-brane consists of 
a “Chan-Paton” bundle with unitary connection; a flat Spin‘ structure on L; and a 
grade lift. A Chan-Paton bundle for a Lagrangian A-brane is generally endowed with 
a flat Spin‘ structure [60, 85, 114, 154]. A Spin® structure arises if £’ does not exist 
as a line bundle, but is obstructed by the same cocycle that obstructs the existence of 


the square root Kj 1/2 of the canonical bundle over the Lagrangian L. Namely, puta- 


tive transition functions g;; and w;; of £’ and Ky, 1/ zi respectively, obey gij8gjk8ki = 
Pijk = WijWjkWki Where ijk = +1. In this case, the cocycle cancels out in the tran- 


sition functions g;;w;; of an honest vector bundle L’ & Ky, we 


> L, called a Spin‘ 
structure. The Ky 1/2 part in a Spin“ structure arises from boundary fermions of the 
open worldsheet [96, Sect. 5] [92, Sect. 3.2], which gives rise to a Spin® structure of 
the normal bundle to the support of a brane. (This proposal is explicitly checked by 
Hemisphere partition functions in [104].) Thus, the canonical coisotropic brane Bec 
is endowed with an ordinary line bundle whereas a Lagrangian A-brane is equipped 
with a Spin“ structure. Since most of the Lagrangian submanifolds in this paper are 
of real two dimensions, there always exists a spin bundle of L, which is a square- 


+12 of L, though it is not necessarily unique. Hence, 


root of the canonical bundle Ky, 
both £’ and Ky 1/2 exist as genuine line bundles in most of the examples in this 


paper and we treat their tensor product L’ @ Ky, 12 asa Spin“ structure. However, 
a subtlety arises when an A-brane degenerates into a different spin structure, which 
will be considered in Sect. 2.7. Moreover, a Lagrangian A-brane is endowed with a 
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flat Spin‘ structure: if Z’ exists as a line bundle, the curvature Fy, of £’ must obey a 
gauge-invariant version of the flatness condition 


Fi + Bl =0, (2.70) 


in the presence of a B-field. Even if £’ does not exist as a line bundle, its square 
(L')? does so that a half of the curvature of (£’)* is subject to (2.70). In sum, for a 
Lagrangian A-brane, we have a Chan-Paton bundle 


LOKI” 


Bi: | (2.71) 


L 


with a flat Spin! structure (2.70). We will sometimes denote a Chan-Paton bundle 
by Bı — L, abusing notation. Morphisms between Lagrangian objects are defined 
in the usual way using the Floer-Fukaya complex generated by intersection points 
between the Lagrangians; see [7] for details. 

Defining the space of morphisms between Lagrangian and coisotropic objects is 
a bit more subtle, and is discussed in detail for flat targets in [8]. The essential idea is 
that the morphism space should be thought of as related to the space of holomorphic 
functions on the intersection, with respect to the transverse holomorphic structure 
on coisotropic objects. For Lagrangian objects, this complex structure obviously 
plays no role, but instanton corrections can appear, in the guise of the contribu- 
tions of holomorphic disks to the differential in the Floer-Fukaya complex. On the 
other hand, for Bec, the transverse holomorphic structure is just a standard complex 
structure and plays an essential role, but instanton corrections are forbidden. In the 
case of general coisotropic branes, both phenomena can be expected to be relevant. 
(For some further discussion of this fact from the worldsheet perspective, as well as 
generalizations to branes of higher rank, see [91].) 

In a hyper-Kahler manifold, we can make use of a B-model analysis as in [82, 
85] to compute the dimension of open strings. The dimension of the representation 
space Y := Hom(%,-, BL) associated to a compact Lagrangian brane Sy can be 
computed with the help of the Grothendieck—Riemann-Roch formula: 


dim Z = dim H°(L, Be ® BI’) 


7 (2.72) 
= f ch(Bec) A ch(By) A Td(TL) , 
L 


Here we denote, by B, a bundle for the corresponding brane including an effect of 
the B-field, abusing notation. 

If a Lagrangian L is of real two dimensions, then the Todd class Td(TL) = 
ch( Ky, Me *)A(TL) is equivalent to ch(Ky, K hj; Consequently, the formula becomes 
a very simple form 
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dim 2 = / ch(Bee) = / ae (2.73) 
L L 20 


for a real two-dimensional Lagrangian L. 

As explained in [85], for a Lagrangian brane L, the space of open strings 
Hom(%,,, BL) can be understood as a geometric quantization of L with a curvature 
on a “prequantum line bundle” Bec ® Br. If X is a complexification of L in the 
sense of [85], then the action of End(%,-) on the quantization Hom(Bec, BL) plays 
the role of the quantized algebra of operators. 

Finally, let us mention a brief word about coefficients. In general, the Fukaya 
category is defined with coefficients in the Novikov ring; this is necessary because 
the sums over instanton contributions that define the differential are formal and not 
necessarily guaranteed to converge. Similarly, deformation quantization of a Poisson 
manifold [53, 77, 111] is not guaranteed to produce convergent series, but only 
a formal deformation in general. We will restrict ourselves to target spaces X for 
which a “good A-model” is expected to exist, meaning that all the series involved 
should in fact converge. The existence of a complete hyper-Kahler metric on X 
should be sufficient to ensure this; see [85] for further discussion of this issue. 

We will proceed to compare the two categories A-Brane(X, wx) and Rep(SH ) 
via the brane quantization. For the comparison, the symmetries play a crucial role. 
In fact, the symmetries of the target space X become the group of auto-equivalences 
of the categories. More concretely, we will investigate the action of & x PSL(2, Z) 
((2.29) and (2.53)) and the Weyl group Z2 generated by z (2.55) on both categories. 

Now we set up the framework so that we will start our expedition to “see” and 
“touch” representations of SH as if they were geometric objects in the target X. 


2.5 (A, B, A)-Branes for Polynomial Representations 


DAHA was introduced by Cherednik in the study of Macdonald polynomials from 
the viewpoint of representation theory [33] in which the distinguished infinite- 
dimensional representation on the ring Y := C, ,[X +)” of symmetric Laurent 
polynomials, called polynomial representation, plays an important role. (See also 
[38] for finite-dimensional modules.) Here, Laurent polynomials in a single vari- 
able X over C4, are symmetrized under the inversion Zz : X œ> X =! so that the 
ring can also be expressed as Y = C}, [X + X -1], This polynomial representation 


of SH is defined by the following formulas: 


© Note, that spherical DAHA is Morita-equivalent to DAHA (2.40), i.e. the category of representa- 
tions of DAHA is equivalent to the category of representations of its spherical subalgebra [131]: 


Rep(#) = Rep(SH) . (2.74) 


See also (4.26) for the explanation from the 2d sigma-model. 
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xe X4+Xx, 
pol : SH > End(Y), ye a= ac ae i Ene 
X-X! X— xX! 
E Ayes gix tt A 
X-X! X —X-! , 
(2.75) 


where w™(X) = q®X is the exponentiated degree operator, often called the q-shift 
operator, that appeared in (C.15) for the quantum torus algebra. In particular, pol(y) 
is the so-called Macdonald difference operator, whose eigenfunctions are symmetric 
Macdonald polynomials [35, 121]. The Macdonald functions of type A, are labeled 
by spin-4 representations, and can be expressed in terms of the basic hypergeometric 
series 


P(X: q,t) = X adi (qr. qg Fr; q; Pt Ox”). (2.76) 


They are acted on diagonally by the Macdonald difference operator, with eigenval- 
ues 
pol) - Pi(Xiq.t) = qit+ qt) P(X 4.0). (2.77) 


Under this basis, the actions of the other generators are 


(1 -4%) (1 — qi) 
(1 — q2/-272) (1 = 4712) 


1— 3) (1 ND 2j=274) 
j+4 ( 1 1 


(1 = 421-212) (1 = 42712) 


pol(x) - Pj (X; q, t) =Pj+1(%;4,t) 4 Pj—1(X;q,t), 


ra ik zj 
pol(z) - Pj(X: q, t) tqt? Pj (Xq, D H'a Pj-1(X;q,t). 


(2.78) 
In fact, the Macdonald polynomials P; form a basis for the ring Y over Cy, 
so that the polynomial representation can be studied with the help of raising and 


lowering operators [105]: 


R; :=x— qi itz = X(qit tY — q’it?) + X`! (qity! — qt) ; 


L; i= x qii) = X (qY — qr) + x qty! — gir). 

(2.79) 

These operators relate adjacent Macdonald polynomials, respectively increasing or 
decreasing the value of j: 


pol(R;) - P}(X3 4,0) = (L — q” t Pini (Xs 9,0), (2.80) 
(1 — qA — 29-14) 


pol(Lj) - P;(X; q, t) = g DAL 


Pj-\(X;q,t). (2.81) 


See Fig.2.5 for a schematic diagram of this action. At tf = 1, this represen- 
tation reduces to the pullback of the lift of A=! in Proposition C.6 so that 
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Ro Ri Rj-2 Rj-1 R; 
1 1 ' j—1 j 
Kor KL K RK 
Li L2 Lj-1 L; Lj+ı 


Fig. 2.5 The action of raising and lowering operators on Macdonald polynomials 


Cherednik’s polynomial representation can be understood as its deformation from 
the symmetrized quantum torus to DAHA. Since the classical limit (q = 1) of the 
Macdonald eigenvalues (2.77) is always t + t~!, the support of the corresponding 
A-brane Bp is given by 


x}. (2.82) 


While the parameter t in SH coincides with the monodromy parameter f at the 
classical limit (q = 1) (see (2.52)), we use f to specify the position of the brane 
because it is the geometric parameter of X. Since it is of type (A, B, A), itis happily 
a Lagrangian submanifold with respect to wx for any value of ft or q. 

To understand the brane Bp for the polynomial representation Y of SH better, 
it is illuminating to consider its relation to the skein module. The skein module of 
type A, [135, 143] of an oriented 3-manifold M3 is defined as 


Clq*2|(isotopy classes of framed links in M3) 


( X agi) (au a ()=-4-47) 


(2.83) 


Sk(M3, SU(2)) := Sk(M3) = 


The skein algebra Sk(C) associated to an oriented closed surface C is defined as 
Sk(C) := Sk(C x [0, 1], SU(2)) , (2.84) 


where the multiplication Sk(C) x Sk(C) —> Sk(C) is given by stacking. As a result, 
Sk(C) is a C[g*?]-associative algebra [144]. 

At the q = | specialization, the skein module Sk(M3) becomes a commutative 
algebra. Moreover, it was shown in [26, 136] that by assigning a loop y : S! > M3 
to Tr(p(y)) where p : mı(M3) > SL(2, C) is the holonomy homomorphism, the 
classical limit q = 1 of Sk(M3) is isomorphic to the coordinate ring of the character 
variety Maat(M3, SL(2, C)). Hence, the skein module Sk(M3) can be understood 
as a BV quantization [66] 


Sk(M3) = BV” (Meaat(M3, SL(2, C))) . 


The skein module of a closed 3-manifold will be studied in Sect. 3.2. 
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If a 3-manifold has a boundary 0M; = C, then we have a module Sk(C) C 
Sk(M3) by pushing a framed links in a thickened boundary C x [0, 1] into the 
bulk M3. In fact, Maa(M3, SL(2, C)) is a holomorphic Lagrangian submanifold 
of Mfa(C, SL(2, C)) with respect to the holomorphic symplectic form Q,. There- 
fore, it can be understood as an (A, B, A)-brane By on Maa(C, SL(2, C)), called 
a Heegaard brane. From the viewpoint of brane quantization, the action of the skein 
algebra can be understood as 


Sk(C) = Hom(B-c, Bee) 
Q Q , (2.85) 
Sk(M3) = Hom(B¢c, By) 


Of our particular interest is the skein algebra Sk(T°?) of a torus, which is the 
t = q specialization of SH [24]. Also, the skein module Sk(S ' X D?) of the solid 
torus is the Grothendieck ring of the category of finite-dimensional representations 
of U; (sl(2)) 


NI 
sy 


Sk(S! x D°) = K°(Rep U, (sl(2))) @ Clq*? (2.86) 
which is spanned by Chebyshev polynomials $;(z) of the second kind [54]. They 
are recursively defined by 


ZS; (Z) = Sj) + Sj-1@) (2.87) 


with the initial conditions So(z) = 1, Sı (z) = z, and they are actually the t = q spe- 
cialization of the Macdonald polynomials 


aj Xitl — x-i-! 


Consequently, the polynomial representation Y of Sig is indeed the skein module 
Sk(T?) C Sk(S! x D?). In fact, the support of the Heegaard brane for the solid 
torus is given by y = 2, which is the A-polynomial of the unknot complement in 
S?. Indeed the eigenvalue of the y operator on S (X + X`!) under the polynomial 
representation Y at t = q isq/+! +q~/~! and its classical limit is y = 2. Thus, the 
polynomial representation Y of SH can be understood as the t-deformation of the 
skein module Sk(T?) C Sk(S! x D°) [93]. 

Let us consider how the symmetries of SH act on the polynomial representation 
. For instance, an action of PSL(2, Z) on Y can be seen by using the maps (2.53) 
combined with (2.75). It is easy to see from (2.53) that the generators of PSL(2, Z) 
maps p to another (A, B, A) brane 
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P ={z =+, x= 'y}, 
T(P)={y=f+i', z=f'x}, (2.89) 
oP) ={x=i +! , y= 'z} 


Under the modular T-transformation 7_, the support does not change and the poly- 
nomial representation Y is invariant, T- (7) = Z since the Macdonald polynomi- 
als are transformed under the modular T-transformation T_ as 


2 A Ei F 
T_(P;)=q7 7t P; wg Tj = qu tt 45;; . (2.90) 


The proof is given at the end (B.36) of Appendix B.2.1. The image o() of the 
polynomial representation of SH under the S-transformation is called the func- 
tional representation, which is explained in Appendix B.2.2. As for the group & of 
the sign changes, the image ¿£ (2) is isomorphic to itself Z = £ (2). On the other 
hand, the image under the involution £ can be obtained by multiplying the minus 
sign to y and z as in (2.29) and the support of the corresponding brane is 


&(P) ={y=-?-f', z=- 'x}. (2.91) 


Finally, the outer automorphism (2.55) changes the Chan-Paton bundle of Sp as 
explained in Sect. 2.3.1 and the support becomes 


uP) ={y=f+i!, z= fx}. (2.92) 


Note that the « image (7) of the polynomial representation can be obtained by 
changing t > q/t in (2.75). 

The perspective from the brane quantization also sheds new light on infinite- 
dimensional representations. We have seen that Cherednik’s polynomial representa- 
tion (2.75) corresponds to the A-brane Bp (2.82) at the particular value of y. It is 
natural to expect that it can be deformed in such a way that the corresponding brane 
is supported on a generic point of y. 

This consideration leads us to the following. Let us consider the multiplicative 
system M C C,,,[X*] generated by all elements of the form (qf X — g~£X~!) for 
all integers £ € Z. Then there is a family of representations of SH on the localiza- 
tion’ of the ring of Laurent polynomials by M 


P = MC, [X*], (2.93) 


7 In other words, 2?! is the ring of rational functions with coefficients in Cg, where denominators 
are always elements in the multiplicative system M such as 


F(X) 
(q™"X — q™X—1)k-m Peas (X _ X—!)ko TAIP (q! X = que X—!)ke e 


FX) € Cg [X7]. 
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labeled by a parameter yı € C* where the representations are defined by 


xX, 
pol, : SH > End(P"), y ra a py! D sae 
yı Eo w xXx-—x-! 1 X-X! 7 
1 teat txt 1 atx tx! _, 
i ae sa aa ee a er Tas 


(2.94) 
Concretely, one is free to deform Cherednik’s polynomial representation (2.75) to 
this larger representation parametrized by yı, as long as we allow denominators to 
be elements of the multiplicative system M. Only at yı = 1, it decomposes into two 
irreducible representations where one is Cherednik’s polynomial representation, and 
the other irreducible representation is 


MC, AX". 


When ¢ = 1, the story reduces to the polynomial representations of the symmetrized 
quantum torus discussed in Appendix C.3.2. Thus, the support of the corresponding 
brane Bj) is expected to be 


supp BY = {y = y f+ yi |}. 


In fact, the eigenfunction of y under pol,, that generalizes the Macdonald poly- 
nomials is constructed in [22, 112, 118] 


Z(X, y1, q, t) = 201 (yi, t yi q; qX’), (2.95) 
where the eigenvalue is 
pol, O) -Z = Op't +y tZ. (2.96) 


Thus, for a generic value of y,, the eigenfunction is an infinite hypergeometric series 
(2.95). However, as easily seen from (2.76), the series truncates to the symmetric 
Macdonald polynomial 


at the specialization yı = q~/ (j € Z>0). 

A geometric interpretation of the multiplicative system M can be given by think- 
ing about the t = 1 limit, where we are interested in the quotient map C* x C* > 
(C* x C*)/Z,. After deforming the target of this covering map, no natural rami- 
fied twofold cover by C* x C* exists. However, such a cover can be constructed 
once we extract the Z2-invariant points X = +1. In fact, O(C*\{X = +1}) admits 


8 Z is the so-called uncapped vertex function in the quantum K-theory of T*CP!. 
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the generator — . A related story exists in the rational limit, where the relevant 
geometry is the deformation of the A; singularity (C x C)/Zp to the total space of 
T*CP!; we discuss this in detail in Appendix B.2.4. 


2.6 Branes with Compact Supports and Finite-Dimensional 
Representations: Object Matching 


Cherednik’s polynomial representation is of particular significance due to the the- 
orems of Cherednik [35, Sect. 2.8-9], which classify finite-dimensional representa- 
tions of SH obtained as quotients of the polynomial representation paired with the 
action of outer automorphisms. Similar to the theory of Verma modules, the polyno- 
mial representation is generically irreducible. A raising operator (2.80) never be null 
since the Macdonald polynomial P}; always has a factor (1 — q?’ t?) in the denomi- 
nator. However, it can occur that a lowering operator L; annihilates one of the Mac- 
donald polynomials P; when certain conditions on the central character are satisfied. 
If this occurs, P; generates a subrepresentation, and a finite-dimensional representa- 
tion of the spherical DAHA appears as the quotient 7 /(P;). We can therefore study 
finite-dimensional representations by asking that the condition pol(L;) - P; = 0 be 
satisfied for some j, i.e. that the factor 


(1 = g/d = gD) + gd -PP) 


q7it?(q2G-Y 12 = 1) (2.98) 
on the right hand side of (2.81) vanishes. 
This amounts to the following three cases: 
gals (2.99a) 
t =-q*, (2.99b) 
Page), (2.99c) 


Here, the exponent in the right hand side of (2.99c) must be an odd integer in order 
for the denominators of Macdonald polynomials as well as (2.98) to be non-zero; 
even exponents are excluded by the definition of the coefficient ring C,, in (2.41). 
We write this odd integer as 2£ — 1. Each of these separate shortening conditions 
will naturally appear as an existence condition of an A-brane with compact support 
in what follows; we will examine each of the resulting finite-dimensional represen- 
tations and the corresponding compact Lagrangian branes in turn. 
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2.6.1 Generic Fibers of the Hitchin Fibration 


First we consider analogous A-branes in this setting; the ones supported on generic 
fibers in the Hitchin fibration. As explained in Sect. 2.1, the Hitchin fibration (2.15) 
is completely integrable, and a generic Hitchin fiber F is holomorphic in complex 
structure J while it is a complex Lagrangian submanifold from the viewpoint of 
the holomorphic two-form Q; for a generic ramification data (2.4). Namely, it is 
a Lagrangian submanifold of type (B, A, A) for any values of (ap, Bp, Yp)-triple. 
Therefore, a generic fiber F can be Lagrangian in a symplectic manifold (X, wx) 
only when the canonical coisotropic brane Bec obeys the condition 6 = 0 in (2.60) 
so that 

We =—-—, and F+B=—. (2.100) 


With 0 Æ 0, there is no A-brane supported on F in the symplectic manifold (X, wx). 
Accordingly, A = |A] is real (i.e. |q] = 1), and the canonical coisotropic brane Bec 
is an A-brane of type (B, A, A). 

An analogous brane appears in the brane quantization of C* x C% for the quan- 
tum torus algebra. As in Appendix C.2.1, a brane is supported on a fiber T? of the 
elliptic fibration T*T* = C* x C*, which gives rise to a finite-dimensional rep- 
resentation, called the cyclic representation. Therefore, we can study a brane sup- 
ported on a generic fiber F of the Hitchin fibration, comparing with the case of the 
quantum torus algebra. 

The branes are indexed by a position of the Hitchin base By (see also Appendix 
C.2.1). Also, the flatness condition (2.70) of the line bundle £’ an A-brane supported 
Bp is 

Fk + B| =0. 


Since F is topologically a two-torus, the flat Spin® structure L’ @ Ki 1/2 of Bp 
can have non-trivial U(1)? holonomy with a choice of spin structure [85]. The 
branes Bå are parametrized by À = (Xm, Ym) € C* x C* where the absolute values 
(lXml, |Ym|) describe its position and the angular phases illustrate the U(1)? holon- 
omy with a choice of spin structures. Namely, the angular phase U(1) encodes the 
holonomy U(1) and a choice of spin structures Z% along a one-cycle of a Riemann 
surface via 


1> Z > U0) ~ U0) > 1. 


We assign the plus sign + for 1 € Z, to the Ramond spin structure, and the minus 
sign — for —1 € Zp to the Neveu-Schwarz spin structure. The choice of spin struc- 
tures appears in the representation of the symmetrized quantum torus discussed in 
Appendix C.3.2. 

Consequently, the computation of the dimension (2.73) of the space 
Hom(Bec, BÀ) is reduced to the period integral (2.23) 
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dim Hom (B.e, BÀ) = = = 2.101 
na Homs P) [ 2r f 27th Rh ( ) 


for arbitrary \. Hence, this leads to the Bohr-Sommerfeld quantization condition 
h = 1/m, or equivalently that q = e?"/” is a primitive mth root of unity for m € 
Zo. In fact, since [F/27] is an integral cohomology class in H 2(%, Z), the fiber 
class relation (2.17) requires te F /27 to be an even integer. Thus, if m is an odd 
positive integer, then we need non-trivial B-flux with 


B Fy 
—=-]/—=1, (2.102) 
F 2m F 2m 
up to an even integer shift. For instance, this can be achieved if the B-field flux over 
V is 1/2 and those over the exceptional divisors D; (i = 1, . . . , 4) are zero. 

In order for the (Bec, Bå)-strings exist, q has to be a primitive mth root of unity 
whereas f can be generic. Under this condition, the action of SH under the general- 
ized polynomial representation pol, in (2.94) commute with X™ — Xm for Xm € C* 
because the shift operator w acts trivially on it. Consequently, the ideal (X” — Xm) 
is invariant under pol,, so that the quotient space 


FÀ = P” /(X" — Xm) , 


is also a representation of SH. Since the Taylor expansion of a denominator in 
the multiplicative system M always truncates under the condition X” = xm, this 
is indeed an m-dimensional representation parametrized by À = (Xm, Ym) where yı 
is any mth root of ym. Hence, we can identify Hom(Be¢c, Bh) with FA when q is a 
primitive mth root of unity where the parameter A € C* x C* exactly matches. 

For generic values of À = (Xm, Ym), the support of a brane BÀ is mapped to 
another Hitchin fiber up to Hamiltonian isotopy under the PSL(2, Z) action, and the 
holonomy of the Chan-Paton bundle, which is a point in the dual torus Jac(F), is 
also transformed appropriately. Namely, PSL(2, Z) acts on À. On the other hand, a 
generic fiber is invariant as a set under the group & of the sign changes as we have 
seen in Sect. 2.1. Correspondingly, the representation FÀ is invariant under © at a 
generic value of À. 

Setting yı = 1, we can symmetrize the story [35, Theorem 2.8.5 (iv)]. Namely, 
since the ideal (X” + X~" — Xm — x, ') is invariant under Cherednik’s polynomial 
representation Y due to the same reason, we have an m-dimensional representation 


Fon) — D(X" +X — xm — xn). (2.103) 
In this case, the corresponding brane pea supported on a Hitchin fiber intersects 


with the support P (2.82) of the polynomial representation. Also, the Chan-Paton 
bundle has the trivial holonomy and the Ramond spin structure around one genera- 
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tor, say the (0, 1)-cycle, of mı (F) = Z @ Z. The parameter xm encodes its position 
in the x coordinate and the holonomy around the other generator of 77 (F). 

Therefore, the representations of this family are analogous to the 
finite-dimensional representations of both symmetrized and ordinary quantum torus 
in terms of A-branes on fibers of the elliptic fibration of the target in the 2d A- 
models as illustrated in Appendix C. As in the case of the symmetrized quantum 
torus Appendix C.3, if a brane Bp with trivial holonomies moves to a special posi- 
tion, we will see below that a special phenomenon occurs. 


2.6.2 Irreducible Components in Singular Fibers of Type h 


As in Fig. 2.2, the Hitchin fibration has three singular fibers of Kodaira type J for 
generic ramification parameters of (ap, 3p, Yp). Since they are still fibers in the 
Hitchin fibration, the irreducible components U; (i = 1, ..., 6) in a singular fiber 
are also Lagrangian submanifolds of type (B, A, A). Therefore, Bec needs to satisfy 
(2.100) in order for Bu, to be A-branes as in the previous subsection. 

For instance, let us investigate a module that the brane Sy, gives rise to. The 
curvature of the line bundle £’ should obey the flatness condition (2.70) 


Fy, + Bly, =0. (2.104) 


Since U, is topologically CP' and a position is fixed, there is no deformation param- 
eter associated to the brane Sy,. Subsequently, one can evaluate the dimension for- 
mula (2.73) 


2r Jy, 27h 2A a) 


dim Hom(Bec, Bu, ) = I 


1 


Consequently, the brane Sy, can exist only at 1/(2h) = n € Z>0, or equivalently 
when q is a primitive 2nth root of unity. 

This is exactly one (2.99a) of the shortening conditions, and under this condition 
a lowering operator (2.81) annihilates the Macdonald polynomial 


pol(L,) - Pa (X; q, t) =0 where P,(X3q,t)=X"+xX™" . (2.106) 
Therefore, the quotient space 
UP := P (Pp) (2.107) 


by an ideal (P,,) is an n-dimensional irreducible representation of spherical DAHA 
[35, Theorem 2.8.5 (ii)] so that one can identify 
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ue = Hom(B¢c, Bu,) : 


As seen in Sect. 2.1, the irreducible component U; is invariant under the sign 
change €; whereas it is mapped to U2 under & (2.31). In fact, it follows from the 
form (2.106) of P, (X) that the finite-dimensional module %, is invariant under the 
sign flip €;. On the other hand, the sign change & leads to another non-isomorphic 
finite-dimensional module. Thus, the brane £:(%y,) corresponds to a brane sup- 
ported on the other irreducible component U; in the same singular fiber from which 
the module comes from 


UO = EUP) = Hom(B.., Bu) . 


In a similar fashion, a brane Sy, supported on another irreducible component in a 
singular fiber gives rise to an image of %{® under PSL(2, Z) and the sign changes 
€1,2. The transformation rule can be read off from (2.38) so that the branes By, , are 
invariant under 7_ whereas they are mapped as 


o(Bu,) = Bu; , o(Bu,) = Bu, , (2.108) 
T+ (Bu) = Bu, , T+(Bu,) = Bu, - 


The corresponding modules % © are obtained from %,” in the same way. 


2.6.3 Moduli Space of G-Bundles 


Next, we consider a brane Sy supported on the moduli space V of G-bundles. For 
the sake of brevity, let us first see the case of 3, = 0. If A is real, only a, can be 
turned on while 7, must vanish in order for V to be Lagrangian with respect to wx. 
As h = |hle® is rotated 0 Æ 0 in the complex plane, the symplectic form we are 
interested in is also rotated from wx to wx according to (2.60). However, this rota- 
tion can be actually compensated by switching on y, so that V can stay Lagrangian 
with respect to wx. According to (2.22) and (2.60), the set V is Lagrangian with 
respect to wx when the following condition holds: 


(5 = %) +iYp 


I 
= h 


= 0 (2.109) 


As a simple check, one can easily see from (2.22) and (2.62) that the integral of the 


symplectic form is zero 
[= [3-0 (2.110) 
y 2r > y 2r , j 
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In addition, if 3, = 0, the submanifold V is also Lagrangian with respect to wy. 
Namely, it is a complex Lagrangian submanifold with respect to a holomorphic 
two-form wg + iwz. When B, is varied, V stays as a Lagrangian submanifold with 
respect to wx while they are no longer Lagrangian with respect to wy. In fact, the 
variation of 3, does not change the holomorphic symplectic form Q; = wx + iwr, 
and therefore keeps wx fixed. In conclusion, V can be Lagrangian with respect to 
wx only when (2.109) holds. Since our concern is the A-model in the symplectic 
manifold (X, wx), the value of @, can be arbitrary. For generic (8p, Yp), V is no 
longer a Lagrangian of type (B, A, A), and it is therefore not contained in a fiber 
of the Hitchin fibration. Nonetheless, unlike a Hitchin fiber, we can consider the 
A-model in a generic symplectic form wx in (2.60) where A can take any complex 
value. 

Under the condition (2.109) with a generic value of f, V is a unique compact 
Lagrangian submanifold, which is topologically CP!. Hence, there is no defor- 
mation parameter for Sy. Consequently, we obtain the dimension of the space of 
(Bec, By)-strings from (2.62) 


p F+B 1 Vp +iXp 1 
dim Hom(B.<, By) = = = 2c—1. (2.111 
Ea v) Í, 2n Oh ih Tug eu) 


The Bohr-Sommerfeld quantization condition imposes its dimension as a positive 
integer 1/2h + 2c — 1 =k + 1 € Zyo, or equivalently £? = —q**?. 

One can observe that this quantization condition is equivalent to the image of 
the shortening condition (2.99b) under the involution v. In fact, under the shorten- 
ing condition t£? = —q**?, the lowering operator in the 1-image of the polynomial 


representation becomes an annihilation operator 


pol(Lk+1) > Pepi (X; q, t) ae =0. 


4q 
Consequently, the quotient space by an ideal (P41) 
UVic) = UP)/(Prri(X q, 4) (2.112) 


is a (k + 1)-dimensional irreducible representation of SH [132]. This representation 
is called the additional series in [35, §2.8.2], and we identify 


(Ik) = Hom(Bec, By) . 


In fact, the support (2.92) of the brane (Bp) intersects with V at P = =q? so 
that Hom(u(Bp), By) = C becomes non-trivial. Hence, «(%+1) can be obtained as 
the quotient of (A) as in (2.112). 

As we have seen at the end of Sect.2.1, the submanifold V is geometrically 
invariant under the sign changes £). so that we expect that the corresponding 
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module %+; is also endowed with the same property. When t? = —q*+?, the Mac- 
donald polynomials obey 


Paa (=X; q, £) = (- DS Pe (X; q, 4), 


which implies that :(%%+1) is indeed invariant under £;. In addition, it is easy to 
check that the full set of y-eigenvalues (the s-image of (2.77)) of (%41) is also 
invariant under é>. 

What makes the space of (Bec, By)-strings even more interesting is that it also 
carries a PSL(2, Z) action. Indeed, as also explained in Sect. 2.1, the submanifold 
V is invariant under PSL(2, Z) symmetry and, as a result, the module 1(%41) is a 
PSL(2, Z) representation. 

Of course, it is then natural to ask which representation it is, and in particular, 
what the corresponding S and T matrices are. To this end, it is more convenient to 
consider the space of (Bec, By)-strings in the target X;-1 under (2.32) or (2.25). 
Then, the corresponding representation is given by 


Vir = P/ (Presi) (2.113) 


under the shortening condition (2.99b). Since the basis fo %+1 is spanned by the 
Macdonald polynomials P;(X) (j =0,...,k), the modular T-transformation 7_ 
acts diagonally in this basis due to (2.90). Under the modular S transformation, this 
basis is transformed to P;(Y) and the submanifold V intersects with both the support 
(2.82) of the branes Sp and that (2.89) of o (Bp). Hence, the modular S-matrix can 
be written as 


Sjj = pol(P)(Y~")) P O |y = Ptg”, t) Pr 'ig.t). 114) 


This is first introduced by Cherednik [34] as a symmetric bilinear pairing of Mac- 
donald polynomials, which we also denote by [P;, Pj] as in (B.21). Moreover, it 
becomes of rank (k + 1) when £? = —q*, and it acts on %+). Therefore, we find 
explicit forms of the S and T matrices as follows, and we will also find a 3d inter- 
pretation of this PSL(2, Z) representation in §3.1.1. 


Conjecture 2.1 The space %4+; is a (k + 1)-dimensional PSL(2, Z) representation, 
with modular S and T matrices given by 


zik k(k-1) | j i(k=j) toh 
Tilya =eq Z i-q 2 Oj jr 0 <j,j < k 


Sip’ lose, = 8t = ig Pig! *?: gt = ig) Pri qt = ig *?). 
(2.115) 
These matrices provide the PSL(2, Z) representation for “refined Chern-Simons the- 
ory”. 
Here we normalize the modular S-transformation (2.114) by the Macdonald 
norm of type A; (See (B.15) for the definition) 
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q”; qtaq; 
(qi=; q7?) j (t?q?; q?)j 


Big, t) := (2.116) 


and 
ka i i 
/2T]2o@tti +47771) k: odd 
kos i i 
2712 (q2*? +q-2-2) k : even 


ak = 


so that $? = 1. We also normalize the T -transformation (2.90) by e™*/!2g—-k&-D/12 


so that (ST)? = 1. For example, the first non-trivial case occurs at k = 1 


l 1 a ee 
” = pti/l2 1 0 s|,, = ae 1 a i(q? —q-?) 
: 0 —i RUC a A) -1 


Next, we turn to less familiar and more interesting modular representation that arises 
from another Lagrangian A-brane in a similar fashion. 


T 


2.6.4 Exceptional Divisors 


Now let us consider an interesting A-brane Sp, supported on an exceptional divisor 
D;, i =1,...,4. As we reviewed in the earlier part of this section, the ramifica- 
tion parameters (&p, Bp, Yp) play the role of resolution/deformation parameters for 
Dj. In particular, when 8, = 0 and h is real, only a, can be turned on while y, 
must vanish in order for D; to be Lagrangian with respect to wx. As h = |hle!® 
is rotated 0 Æ 0 in the complex plane, the exceptional divisors D; stay Lagrangian 
with respect to wx if the deformation parameter Y, + ia, € C in complex structure 
J is proportional to ih, namely, 


Yp +i, 
2ih 


Im =6, (2.117) 


Here the value of 6, can be arbitrary as in the previous case. It is easy to verify 


from (2.24) and (2.62) that 
i. Im Q _ We 0 
D; 2r 7 D; QT =~ i 


The story goes as before. The flatness condition (2.70) of the Chan-Paton bundle 
for the brane Bp, is 


Fy, Blas =0, 


Since it is topologically CP', there is no holonomy and no deformation parameter 
for Bp,. Subsequently, the dimension can be computed as 
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es m 2.118 
z c 5° (2.118) 


dim Hom(B¢c., Bp, ) = / 


i 


The Bohr-Sommerfeld quantization condition imposes its dimension as a positive 
integer —c + 1/2 = £ € Zo, or equivalently t? = q7», which is (2.99c). 
When t = q~?—)/?, the lowering operator annihilates the Macdonald polyno- 
mial 
pol(Ly¢) - Poe(X3q,0) =0. (2.119) 


Therefore, the quotient space 
Du = P/(Px) (2.120) 


by an ideal (P2¢) is a 2€-dimensional representation of SH . In fact, it is not irre- 
ducible, and decomposes into two irreducible representations 


Bn = BOD. (2.121) 


Because P; and Pze—j—ı have the same eigenvalue of the Macdonald difference 


—(2€-1)/2 


operator (2.77) when t = q , their combinations indeed form bases of gr 


D ine [Pi Pre-j-1(X) 2) _ aD Pi(X) — Paja) 
P= Dtg hone! Dulee Reo! 
j=0 j=0 ’ 
(2.122) 
Consequently, they are related by the sign change DP =f (J). In fact, the sup- 
port (2.82) of the brane Bp intersects with D1 2 at t = q~°""))” so that DP ® 2P 
can be obtained as the quotient of Z as in (2.120). 

Even when t = —q~°'-/?, the shortening condition (2.119) holds, but the 
eigenvalues (2.77) of the y-operator have the opposite sign as in (2.91). Therefore, 
the corresponding irreducible representations can be obtained by the sign change £2 
: (1,2) 
in (2.29) from J”. 

As a result, for t? = g~°"—, there are four irreducible finite-dimensional rep- 
resentations [35, Theorem 2.8.1] that are obtained from g by the sign changes 
€1,2. This is analogous to the relationship among the exceptional divisors under the 
sign changes (2.30). Therefore, we identify these modules to the spaces of open 
(Bec, Bp, )-strings as 


2P =Hom(Bece, Bp), 2P = & (2) = Hom(Bee, Bp, ) , 
BP := (J) =Hom(Bee, Bp), 2O := E&I) = & (GM) = Hom(Bec, Bo, ) - 


(2.123) 
The modules pe? can be obtained as the quotient of the polynomial representation 
because the support (2.82) of Bp intersects with D, and D2. On the other hand, its 
&-image (2.92) intersects with D3 and D4. (See also Fig. 2.7.) 
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Under the PSL(2, Z) action, the four irreducible representations are transformed 
as in (2.37). Namely, the modular T-transformation 7_ exchanges DO and p” 
whereas DP and 2P are invariant. Also, the modular S-transformation 
o exchanges 2P and G? whereas the modules DP and Qe are invariant. 


Ter 2P < g® and DP ; Gg? are invariant , 
gol 2P < g® and DP ; GQ” are invariant , (2.124) 


o: 2P < 2P and DP ; g® are invariant . 


Thus, only the module 2; D Hom(Bec, Bp, ) among the four modules becomes a 
PSL(2, Z) representation. 

Let us find the modular S and T matrices for this PSL(2, Z) representation. As 
we have seen, the polynomial representation Y captures both gy” and 2P so 
that the S-matrix (2.114) truncates a matrix of size 2£ x 2£ under the shortening 
condition (2.99c). However, the matrix has rank £ and it acts non-trivially only on 
g under the change (2.122) of basis 


Siy = G'S Gla, t =g], O<sj'Se-1 (2.125) 


where G is a matrix of size 2 x 2£ that changes the basis according to (2.122). This 
gives the geometric interpretation of the basis change in [116, §4.1]. As a result, we 
find the following explicit forms of the S and T matrices, and a 3d interpretation 
of our A-model setup in §3.1.1 will identify an intrinsic physical meaning of the 
PSL(2, Z) representation: 


Conjecture 2.2 The space DP is an -dimensional PSL(2, Z) representation, with 
modular S and T matrices given by 


@-l)ri (2-1-1) itk-j) 
6 q4 6 


Tjj õp O<jj'<£-1 


SENS 


gv =e 
% (2.126) 


Silo = be 8iQ.t =q 


The PSL(2, Z) representation comes from a modular tensor category associated to 
the Argyres-Douglas theory of type (A1, A2¢œ-1)). These matrices coincide with 
those of the (2, 2@ + 1) Virasoro minimal model at q = e7?7"/@F), 


Here we normalize (2.125) by the Macdonald norm (2.116) and 


£-2 


by = 2] ja" 2i gre) 
i=0 


so that S? = 1. We also normalize (2.90) by e@—D™/6g-CKDE-D/® so that 
(ST) =1. 
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Table 2.2 A summary of finite-dimensional representations of SH with corresponding shortening 
and A-brane conditions 


finite-dim rep shortening condition A-brane condition 
Uy q” =1 n= + 
ic ee ae k= og + me 
D Pag 2 f= vere 


For instance, when £ = 2, these matrices become 


1 . 
z [qz 0 i 1-(q-1+q! 
T | go —e6 q ? A , Slav -—_( (q +q ’) . 
(=2 0 q? t=2 q3? — q7 1 -1 


When q = ein, they coincide with the modular matrices of the (2, 5) Virasoro 
minimal model although an appropriate change of basis is required to bring the S- 
matrix into the standard form (Table 2.2). 


2.7 Bound States of Branes and Short Exact Sequences: 
Morphism Matching 


We have hitherto studied generic conditions when an individual A-brane supported 
on a compact irreducible Lagrangian can exist. Next, we will figure out the situ- 
ation in which two distinct A-branes are present at a singular fiber of the Hitchin 
fibration. When two distinct A-branes intersect at a singular fiber, they will form 
a bound state. In this section, we will study a bound state of compact A-branes 
and identify the corresponding SH-module. This provide evidence of the equiva- 
lent morphism structure under the functor (1.3), restricting to the subcategory of 
compact Lagrangian A-branes with that of finite-dimensional SH-modules. 


2.7.1 At Singular Fiber of Type Ih 


As seen in Sects. 2.6.1 and 2.6.2, the compact branes Sp and Sy, can exist when 
q is a root of unity and ¢ is generic. As Fig. 2.6 shows, the irreducible components 
U; and U; at the singular fiber 7~'(b,) of type h intersect at two points pı and pz. 
Therefore, the Floer complex [56, 57] (or morphisms) of the two A-branes Sy, and 
Bu, is 


Hom*(By,, Bu,) := CF*(By,, Bu,) = C(p1) 8 Cpo). (2.127) 
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Fig. 2.6 At the singular E 
fiber m7! (b1), &2 exchanges 2 
the irreducible components, 

U; and Us, by the 180° 

rotation along the 

(0, 1)-circle (longitude). 

Therefore, £2 exchanges p 

and p2. On the other hand, z 

exchanges U; and U2 by P2 Pi 
fixing pı and p2. Besides, £1 

maps each irreducible 

component to itself by the 

180° rotation along the 

(1, 0)-circle (meridian) 


£1 


Note that the Floer complexes C F* (Bu, , Bu, ) and C F* (Bu, , Bu, ) and the differ- 
entials on them are Poincaré-dual to each other. Namely, each intersection point p; 
defines generators of both complexes, whose degrees sum to 2 (the complex dimen- 
sion of the target). 

This implies that there are two bound states of By, and By, as A-branes. Let us 
consider one natural candidate for them: a brane BA degenerating into the singular 
fiber m~! (b1) of type J). First of all, the dimension m of Hom(B¢c, Bh) needs to be 
even m = 2n in order for the brane to be supported on a singular fiber because the 
evaluation of the integral cohomology class [F,/(27)] over a singular fiber cannot 
be odd like (2.102). There is also a topological constraint to be a bound state of the 
branes Sy, and By,. As illustrated in Fig. 2.6, a one-cycle, say the (1, 0)-cycle, of a 
torus is pinched to a double point at two locations so that the singular fiber m~! (b1) 
topologically consists of two copies of CP’. Therefore, it has the unique bounding 
spin structure along the (1, 0)-cycle, which is Neveu-Schwarz. Consequently, only 
a brane BEP with trivial holonomy and the Neveu-Schwarz spin structure along 
the (1, 0)-cycle of F can degenerate to a bound state of the branes By, and By, at 
the singular fiber m~! (b1). 

There is indeed a corresponding representation of SH. We see that the support 
U; U Up is invariant under 7_ (as a set). Thus, a brane Be wD can enter the singular 
fiber when the corresponding module FE E 
ideals 


is T_-invariant, namely when the two 


(xm J x72 — Xn — x5), (T ax” r3 xo” =a i) 


coincide. Under the condition (2.99a), the 2nth Macdonald polynomial takes the 
form Pan = X” + X7” +2 =(X"+ X”), and (2.90) yields 7- (1) = 1 and 
T- (Pan) = t” Pan. For a generic value of t, only when x2, = —1, we therefore 


have the 7_-invariant module a Ye p /(Pan). Moreover, since Px, = (P,)* 
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under (2.99a), the quotient of the polynomial representation Y yields a short exact 
sequence 
03 YO > FP > Uu >O. (2.128) 


The representation FE H corresponds to the bound state BEH, As explained in 
Sect. 2.6, the raising operator (2.80) of Y does not become null because the prefac- 
tor (1 — q7/t?) cancels with the denominator of P ;+1- Consequently, this short exact 
sequence (2.128) does not split as a direct sum, but rather is a nontrivial extension 
of YD by YP. This is analogous to the fact that C[X]/(X7”) > C[X]/(X") can- 
not split as a C[X]-module. As such, when the gradings are chosen such that %2 
are in degree zero, the degree of the corresponding morphism between the A-branes 
is one, and corresponds to the class in Hom! (Buy, , Bu,) represented by BOP 4 
Although this paper does not determine the degree of the morphism in the A-brane 
category, the representation category of SH predicts one. Even in what follows, 
non-trivial extensions in the representation category give a description of degree- 
one morphisms (extensions or bound states) of various distinct compact A-branes. 
Determining the degree of the morphisms directly in the A-brane category is left for 
future work. 

Since Hom* (By, , Hu, ) is two-dimensional, there must be another generator. To 
identify it, we consider the symmetries. As Fig. 2.6 illustrates, 2 and » exchange the 
irreducible components U; and U; at the singular fiber. More precisely, € acts on 
the singular fiber as the 180° rotation along the (0, 1)-circle (longitude) so that the 
intersection points pı 2 are exchanged by &2. On the other hand, « exchanges U; and 
U: by fixing pı,2. Consequently, the images of the brane BOP under the symme- 
tries é and ų are non-isomorphic objects in the A-brane category. They indeed span 
the morphism space 


Hom! (By,, Bu,) = Cla(BO)) @ CUBE) . (2.129) 


As a result, two irreducible branes can form bound states in more than one way. 
Similarly, the images of the brane FE Ð under the symmetries z and ų¿ are non- 


isomorphic in the representation category of SH for n > 1. The image of the short 
exact sequence (2.128) under £2 becomes 


03 YY > EFEO) > Uw > 0. (2.130) 
Likewise, The image of the short exact sequence (2.128) under 1 becomes 
03 UO > (FP) > UP > 0. (2.131) 


By using the polynomial representation (2.75), one can read off the action of the 
generators x and y on these representations as 


? Often literature in mathematics uses the notation Ext! instead of Hom!. Here they have the same 
meaning. 
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UW) ue) y u 
OQ # .2. 0.0 O * ... 0 0 
x 0 * 00 * 0 *« 0 0 
O *« ` * 0 0 O* “. * O 0 
0 0 0 * 0 0 0 * 
a |o 0 * 0 P =|00... * 0 
EFD) s0.. 00 UF P) 9 0 * .. 00 
x 0 * 00 x0 * 0 0 
O* > x 0 O* ` * 0 
0 0 0 x 0 0 0 * 
0 0 x 0 0 0... * 0 
(2.132) 


on the basis where y acts diagonally as diag(t + t7!, gt +. qu!t7!,..., qt + 
q'-*"t-!). Note that the upper-left block and lower-right matrices of the x actions 
are the same whereas the lower-left matrices are different. These matrices explicitly 
show that £2 (FE Ð) and UFS ) are not isomorphic. 

In fact, the composition £2 o 4 leaves Sy, and By, as they are, respectively. How- 
ever, it maps yo to a different object. Correspondingly, we have a short exact 
sequence 


03> UP > Gol Fy?) = UY? > 0, (2.133) 


which is not isomorphic to (2.128). Therefore, they span the morphism space of two 
dimensions 


Hom! (By,, Bu,) = C(IBEO™) @ Clo (BEP), (2.134) 


which is Poincaré-dual to (2.129). In conclusion, when two compound branes inter- 
sect two points, they can form non-isomorphic bound states with the same support 
in the A-brane category, and these bound states are related to subtleties defining 
A-branes supported on singular submanifolds. 

At the other singular fibers m—'(bz.3), there are similar bound states. As in 
(2.108), o € PSL(2, Z) maps (2.129) to Hom! (By,, By,). Also, 7, € PSL(2, Z) 
maps (2.129) to Hom! (By,, Büz). 


2.7.2 At Global Nilpotent Cone of Type I, 


Next, let us consider the case in which both the A-branes Sy and Bp, exist. In 
order for both By and Bp, to be Lagrangian, (2.109) and (2.117) need to be sat- 
isfied, which implies y, = 0 and A is real whereas œ, and B, can be arbitrary. 
Therefore, the symplectic form must be wx = wx /h. In this situation, F and U; are 
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also Lagrangian with respect to the symplectic form. Moreover, the quantization 
conditions, (2.118) and (2.111), for both Sp, and By are 


1 1 
— z= —+2c-1=k+1 2.1 
ets l, aR t +1, (2.135) 


which implies that 1/2 = 2£ + k + 1. In other words, the two shortening condi- 
tions lead to the other one 


(2.99c) and u(2.99b) —> (2.99a) where n=2€+k+4+1. 


Under this condition, there are therefore finite-dimensional representations of three 
kinds, Hom(B¢c, By;), Hom(Bec, By) and Hom(Bec, Bp, ). On the representa- 
tion theory side, the quotient of the polynomial representation yields a short exact 
sequence 


0 (h) — YO L A p 9M — 0. (2.136) 


We also note that there exist similar short exact sequences for the images of Y%," 
under the symmetry & x PSL(2, Z) in Sect. 2.6.2 under the same shortening condi- 
tion. 

In a similar fashion, if the branes Bp, and Sy, exist simultaneously, their quan- 
tization conditions guarantee the existence of By. Also, if we assume the presence 
of the branes By and By,, then the quantization condition for Bp, follows. In fact, 
it is straightforward to check that, under the relation n = k + 1 + 2£, we have 


(2.99c) and (2.99a) —> 1(2.99b), 


(2.137) 
(2.99a) and 1(2.99b) —> (2.99c). 
Subsequently, we have the short exact sequence (2.136). 

If Bp A 0, the Hitchin fibration has the three singular fibers of type Jy (Fig. 2.2), 
and the Lagrangians V and Bp, are not contained in a Hitchin fiber. Thus, the short 
exact sequence (2.136) implies that a Hamiltonian isotopy can deform the brane 
Sy, in such a way that it contains Sy as subbranes. The situation becomes much 
more lucid when B, = 0. As Bp — 0, the three singular fibers meet simultaneously 
and transform into the singular fiber of type [> , which is the global nilpotent cone. In 
this process, the A-brane Sy, becomes a bound state of Bp,, Bp, and By because 
of (2.19). The short exact sequence (2.136) indeed corresponds to the bound state 
as illustrated in Fig. 2.7. A similar story holds for the other branes By, and they 
become bound states of irreducible branes according to the relation (2.19) of the 
second homology group. 

As explained above, the short exact sequence (2.136) does not split into the direct 
sum because the raising operator (2.80) of Y never becomes null. Geometrically, 
the choice of the direction of the arrows in (2.136) comes from how the support 
(2.82) of Sp intersects with the global nilpotent cone. As explained in Sects. 2.6.3 
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F N 
FH, 
Mu E2 
F 
Bu 
gen pt 0 


Fig. 2.7 This figure depicts the correspondence between compact supports of (B, A, A)-branes 
and finite-dimensional modules of the spherical DAHA when h = 1/2n, &p/2ħ = £ and Bp = 
0 = Yp. Note that n = 2€+k+1 


and 2.6.4, the support (2.82) of Bp cuts through real one-dimensional slices of the 
exceptional divisors D; 2, but it does not intersect with V. As a result, the brane By 
becomes a subbrane of By, whereas Bp, © Bp, becomes its quotient. 

On the other hand, the s-image (Bp) intersects with V whereas it does not with 
exceptional divisors D;. Consequently, there is a short exact sequence 


0 — 2® a B® — (UYO) — (h-u) — 0. (2.138) 
Once we take é2-image of this short exact sequence, we have 
0 2” p 2P 5 & o (UYO) — (h-u) — 0. (2.139) 
because 1(%,—2¢) is €2-invariant. 

Now we are ready to compare the morphism structures of the two categories 
under the shortening condition A = 1/2n and «,/h = £. As Fig. 2.7 illustrates, the 
supports of branes Sy and Bp, intersect at one point qı so that the morphism space 
between them is one-dimensional: 


Hom! (Bp,, By) = Clq) . (2.140) 


This means that there is one bound state of By and Bp, . Indeed, we find the corre- 
sponding representation from (2.136): 


0 — (ha) — F2) — 2P — 0. (2.141) 
Its Poincare dual in the representation category can be obtained from (2.139) 


0 — DY? — G0 (Y%)/¢(9) — (h-u) — 0. (2.142) 
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By using the sign change group &, we obtain short exact sequences analogous to 
(2.141), which changes from DP to pË (i = 2, 3, 4). We can further pursue the 
comparison of the morphism structure. In the A-brane category, the morphism space 
between By and Bp, ® Bp, is two-dimensional: 


Hom! (Bp, © Bp,, By) = C(qi) ® C(qa) . (2.143) 
It is easy to find the corresponding representations 


0 — Vint) — FMA) 2P — 2P @ IP — 0, 


(2.144) 
0 — (ha) > FIP) OB? — 2P © IP — 0 

In fact, the short exact sequence (2.136) can be understood as the diagonal element 

corresponding to qı + q2 € Hom! (Bp, ® Bp,, By). More generally, we have 


Hom! (Sier Bp,, By) = GierC (qi) , (2.145) 


where 7 is a subset of {1, 2, 3, 4}. The diagonal element in the representation cate- 
gory is 
0 —> UV) > Mbe S ier 2P — 0, (2.146) 


where |/| is the cardinality of the set 7. We write the corresponding A-brane 
By € Hom! (Ojer Bp,, By) , (2.147) 


which is supported on N’ := UjeD; U V. 

If the cardinality |Z| is three, the corresponding brane is supported on V plus 
three exceptional divisors, and the representation ./‘ is not obtained by a quotient 
of the polynomial representation. Therefore, these are new finite-dimensional repre- 
sentations, which do not appear in the theorems of Cherednik [35, Sects. 2.8-9]. 

When J = {1, 2, 3, 4}, the support of the corresponding brane is the entire global 
nilpotent cone N (2.16) so that we simply write it as By. It turns out that this brane 
gives rise to another interesting bound state in the A-brane, which we will see below. 
The global nilpotent cone. In fact, when n — k — 1 is odd (or equivalently c € 
Z<o), there is a short exact sequence 

0 — (ha) — FOP — Mnri — 0, (2.148) 
In fact, when both (2.99a) and :(2.99b) are satisfied, we have pol(Lo,—,_1) - 
Pən-ķ-1 = 0. Furthermore, when n — k — 1 is odd, then Mn-k-1 := Z /(Pan-k-1) 
becomes an irreducible module of dimension 2n — k — 1. The short exact sequence 


(2.148) illustrates that the module -%,_,_; can also be obtained by the quotient 
Foy? Ia). 
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When Bp = 0 = yp, the Hitchin fibration has one singular fiber of type Jj, and 
the entire global nilpotent cone N is Lagrangian with respect to wx. The short exact 
sequence (2.148) indeed depicts the situation where the brane HEH with the 
Ramond spin structures enters the global nilpotent cone. Since it has a different spin 
structure, the brane is not decomposed into each irreducible component. As a result, 
the brane PTH becomes the bound state of two branes; By and By. Actually, 
using the fiber class relation (2.17) with (2.101) and (2.111), one can evaluate the 


dimension formula for an A-brane By 


F+B w 1 
dim Hom (Be, By) = = = 2—1. 2.149 
oe N) Í On [5 mt le) 


From (2.135), this is equal to 2n — k — 1, and the space of (Bec, By)-strings there- 
fore corresponds to the module .%,,_,—; in (2.148). 

One delicate point arises for constructing the Chan-Paton bundle for By because 
N is not a manifold. Since V is linked with the exceptional divisors D; in By, the 
Chan-Paton bundle for Sy is no longer well-defined at the four joining points of 
V and D;. The Chan-Paton bundle becomes a putative “line bundle” £’ over each 
exceptional divisor D; and the curvature Fy of its connection has a half-integral flux 


over it [60] 
1 
D; 2 


while it cancels with the B-field due to (2.70) 
Fa + Bly =0. 


In other words, £’ restricted to an exceptional divisor D; is a “square root” of the 
O(-l) > CP! bundle and the B-field flux over it is 1/2. As a result, we have 


f F+B / wI n—k-l1 1 
e, = = +Z, 
D; 2r D; 2rh 2 2 


which gives the condition that n — k — 1 is odd. 

Under this circumstance, the line bundle £ > X (2.57) for Bec is actually the 
2nth tensor product of the determinant line bundle [95, Sect. 8] of the Hitchin moduli 
space. As a result, the geometric quantization of V provides the quantum Hilbert 
space %+1 on a once-punctured torus in Chern-Simons theory [82]. The additional 
series Yj, at a primitive 2nth root of unity q = e™/” is called perfect representation 
[35, Sect. 2.9.3]. Moreover, when n = k + 2, the additional series %+) of dimension 
k + 1 is isomorphic to the well-known Verlinde formula of S2) k With level k for a 
torus (without puncture) [147]. 

Let us end this section by commenting briefly on future directions. There are an 
enormous number of non-compact Lagrangian submanifolds in the moduli space 
of Higgs bundles that have been studied in their own right: for example, the image 
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of the Hitchin section, the brane of opers (see [25, 86, 124, 129] in a similar con- 
text), or the A-polynomial of any knot [80]. Each of these geometric objects should 
naturally be associated with an SH-module whose behavior precisely matches the 
geometric properties of the object, just as we demonstrate occurs for compact 
Lagrangians and for the (generalized) polynomial representation. It would be of 
great interest to further pursue this correspondence for infinite-dimensional repre- 
sentations, even just in the rank-one case. 

It would also be interesting to connect explicitly with other mathematical con- 
texts in which algebraic approaches to the Fukaya category or equivalences between 
Fukaya categories and module categories appear. To give just one example, in [51], 
Etgti and Lekili study the Chekanov-Eliashberg dg-algebra associated with a Leg- 
endrian link in a Weinstein four-manifold for a given graph. They show that this 
algebra is A, -quasi-isomorphic to, roughly speaking, the endomorphism algebra 
of a collection of generating objects of the wrapped Fukaya category of the surface, 
and go on to recover the multiplicative preprojective algebra studied in [31] in the 
context of the Deligne—Simpson problem from the Legendrian link. When the graph 
in question is the affine D4 Dynkin diagram, it is expected that the corresponding 
preprojective algebra is related to DAHA. (We thank A. Oblomkov for private com- 
munication related to this point.) The computations of the (wrapped) Fukaya cate- 
gory of the above four-manifolds in [51] thus may provide an interesting perspective 
on our Claim 1.1 as well as its generalization to other algebras. 
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Chapter 3 A) 
3d Theories and Modularity get 


In this section, we connect the brane setup of the above 2d A-model to 3d/3d corre- 
spondence and shed light on various modular representations coming from geometry. 
In particular, we explain the origin for the explicit form of the S$ and T matrices in 
Conjectures 2.1 and 2.2. The modular action in Conjecture 2.1 turns out to be the one 
of refined Chern—Simons theory [4]. On the other hand, the modular action in Con- 
jecture 2.2 is a “hidden” (surprising) one; it is realized on the vector space spanned 
by the set of connected components of fixed points under the Hitchin U(1)g action 
on the moduli space of wild Higgs bundles associated to a certain Argyres—Douglas 
theory. Furthermore, we propose how non-standard (e.g. logarithmic) modular data 
of MTC[M3] can be described in terms of the A-model on the Hitchin moduli space 
associated with the Heegaard decomposition of M3 and discuss possible connections 
to skein modules of closed oriented 3-manifolds. 

One advantage of connecting the 2d A-model to the three-dimensional perspective 
is that all of these modular actions admit a natural categorification. In other words, 
in all of these instances it makes sense to ask if the space of open strings in the 
Hitchin moduli space can be realized as the Grothendieck groups of a tensor category 
(possibly, non-unitary or non-semisimple): 


SL(2, Z) C K°(MTC) . 


Finally, we will see that, in the opposite direction, the relation to the 2d A-model 
offers a unifying home for the above-mentioned modular data. 


3.1 DAHA and Modularity 


The fivebrane system in M-theory that provides geometric origins of the modular 
representations on DAHA modules is the following familiar setting for the 3d/3d 
correspondence 
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space-time: S! x,, (TN x T*M3) 31 
N M5-branes: S! x, D? x M3 -D 
where M; is a 3-manifold, D? is a two-dimensional disk (or a cigar), and TN = Rt 
is the Taub-NUT space. Writing the local complex coordinates (z1, z2) on T N, such 
that zı also parametrizes D?, we turn on the Omega-background, i.e. a holonomy 
along S! that provides a twisting of TN via an isometry 


(21, 22) > (zi, t'z2) . (3.2) 


In this setting, the symmetry group of the 6d (2,0) theory on the M5-branes is 
reduced to 


SO(6)z x SO(5)r —> SO(3); x SO(B)2 x SOB)r x SO(2)R , (3.3) 


where SO(3); and SO(3), are the space-time symmetry of S! x4 D? and M3, respec- 
tively, and SO(3)g is the symmetry of a cotangent fiber of T* M3. We perform a 
topological twist by taking the diagonal subgroup SO(3)diag of SO(3)2 x SO(3)g so 
that the resulting theory is partially topological (along M3). After the partial topo- 
logical twist, the effective theory on S! Xq D? only depends on topology (but not 
the metric) on M3 and is described by 3d M = 2 theory often denoted T[M3],' with 
the R-symmetry given by SO(2)z in (3.3). When M3 is a Seifert manifold, there is 
an extra U(1)s5 symmetry associated with the two directions in the cotangent bundle 
normal to the Seifert fiber. As a result, the partition function, called the half-index, of 
the 3d M = 2 theory T[M3] on S! x, D? with a 2d.N = (0, 2) boundary condition 
B in this setting is defined as 


Zrim(S' xq D?, Baily et eee (3.4) 


where S and R are charges of U(1)s5 and SO(2) r, respectively, A is the Hamiltonian, 
and J; is an eigenvalue of the Cartan subalgebra of SO(3),. The difference between 
U(1)s and SO(2)z is customarily denoted U(1)g in [74-76], and its fugacity is the 
variable ¢ in (3.4). 

Notice that the system (3.1) does not involve a once-punctured torus which was 
used to define the Hitchin moduli space and the parameter f as in the previous 
section. However, for gauge groups of type A, the following two physical systems 
are expected to be closely related: 


e 6d (2, 0) theory on S xc p With C, being a once-punctured torus. 
e 4d. N = 2* theory on S!. 


Although the two systems would have different spectra,” their BPS sectors are 
expected to be equivalent. In particular, at low energy both systems realize a 3d 


1 In this section, we restrict ourselves to SU(N) gauge group so that T[M3, SU(N)] = T[M3]. 


2 For example, many KK modes of the 6d theory on T? have no counterparts in the 4d theory. Even 
if one replaces the 4d M = 2* theory with 6d (2, 0) theory on a torus (with the mass parameter 
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sigma-model onto the Hitchin moduli space. The deformation parameters can also 
be identified as follows. 

On one side, the (classical) deformations are parametrized by the triplet 
(ap, By, Yp) Of monodromy parameters around the puncture as introduced before. 
On the other side, for the 4d M = 2* theory, the triplet of deformation parameters 
is given by the complex mass of the adjoint hyper-multiplet in 4d together with the 
holonomy of the U(1) flavor symmetry along the circle. In the system (3.1), the 4d 
N = 2* theory is obtained by the compactification of the 6d theory on T? C M3 
with holonomy for U(1), along S! (3.4). In particular, the parameter t defined above 
is identified with the ż in DAHA. In this section, we will be looking at questions 
whose answers depend holomorphically on t, as required by supersymmetry on M3, 
and the other deformation parameter 3, won’t play a role. For example, what com- 
plex connections on T? C M; can be extended to the entire M3 is a question that is 
“holomorphic in J” (and given by intersections of (A, B, A)-branes in the Hitchin 
moduli space). Notice that this non-trivial relation only holds for a gauge group of 
type A, while for other types the class S construction of 4d M = 2* theory is gener- 
ally unknown, and the once-punctured torus does not lead to either the 4d VV = 2* 
theory or DAHA. 

One statement of the 3d/3d correspondence is the duality between the non- 
perturbative complex SL(N, C) Chern-Simons theory on M3 and the 3d N = 2 
theory T[M3] on S! x, D?, so that the partition functions of both sides are iden- 
tified. As explained in [68, 75, 76], for a particular class of boundary conditions 
Bp labeled by b € (Spin®(M3))*~!, the partition function of the 3d M = 2 theory 
T[M3]onS! x 4 D? counts BPS states and, therefore, has a q-expansions with integer 
coefficients and integer q-powers? 


Zrtms0(q,t) = Zrim(S! x4 D?, Bp) . (3.5) 


The relation to Chern—Simons theory involves the same space of boundary conditions 
with a “dual” basis, related to B, via the S-matrix 


D eri Ei kai, bow) 
o€Gy 


Se l 
t T Stabs, (a)| - [Tor Hi (M3, 2)| 0-04 


In particular, the partition function of the non-perturbative SL(N, C) Chern—Simons 
theory on M3 is given by 


logq\ “= z = 
(- Ari ) > erik KGDS ZT 1M3),6(4 t) (3.6) 
a,be (Spin (M3))%—! 


replaced by holonomies for a U(1) subgroup of the R-symmetry on T?) the full spectrum is still 
different. One way to see this is that the latter theory depends on all three U(1) holonomies on 
T? x S! in a periodic way, and they are completely symmetric, while this is not the case for the 
former theory obtained from a punctured torus. 


Ap 


3 Up to an overall factor q“? that plays an important role but is not relevant to the present discussion. 
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with generic |q| < 1, and specializes to that of SU(N) Chern—Simons theory when 
q > e7"'/* with integer (renormalized) level k = k + N. The origin of log q factors 
is explained in [137]. Note that the linking pairing £k on Spin‘ (M3) is defined by the 
Pontryagin duality. We will see shortly that it is the basis of BPS partition functions 
(3.5) and the corresponding boundary conditions $, that are most naturally related 
to DAHA. 

Consider a simple example where M3 = L(p, 1) is a Lens space. The lens space 
L(p, 1) can be constructed by gluing two solid tori with a homeomorphism between 
the boundary tori sending the meridian (1, 0) of one torus to a (1, p) cycle of the 
other. The corresponding 3d V = 2 SU(N) gauge theory T[L(p, 1)] consists of one 
adjoint chiral multiplet ® with R-charge 2 and N = 2 Chern—Simons term with level 
p. Consequently, the factor Z711(p,1)),» labeled by b € (Spin°(M3))"~! is defined 
by 


Z (q,t) = zJ IX x: q, NOX, 9) (3.7) 
T{L(p, 11.0 íg, =W wet 2ni X `q, b 74), . 


(X9; q?) Z^-!; p N-I g2 ae nj 
TO=] [axia 8 Eos De Pawe x. 
acR nepZN-!+b i=1 

Here we impose the Neumann boundary condition at the boundary 0(S! Xq D?) on 
the vector multiplet and adjoint chiral multiplet, which give rise to the numerator and 
denominator of the Macdonald measure Y by one-loop determinant [158] (see also 
(B.14)). In addition, the boundary partition function ee encodes the information 
about the Chern—Simons term with level p, and 2d M = (0, 2) boundary condition 
at the boundary 0(S! x, D?) is labeled by b € (Spin‘(M3))%~!. In fact, Zr Lp.Whb 
can be understood as the half-index of the 3d/2d coupled system. For more detail, 
we refer to [75, 76]. 

When the lens space L(p, 1) is constructed by gluing two solid tori, we can include 
a Wilson loop in each solid torus. The reduced partition function with boundary 
condition specified by Spin‘ structure b results in 


| 1 dX 
Zr L(p.V1.b N! Jixj=1 27i X 


rX) OF" PX) PAXP, 


(3.8) 
where the conjugation f +> f is defined in (B.13). In particular, when p = 0, 
i.e. L(0, 1) = S! x S*, the partition function vanishes unless the total charge of 
two Wilson loops is zero. This defines the Macdonald inner product (B.15) 


ZTIL(p.1)],b (À, H) = 


(Py, Px) = Žriro. nol, U) = San rq, t). 


In the case of M3 = S°, this defines the symmetric bilinear pairing [34, 50, 101] 
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[Py, Pul = ZrpraayoOs H) = Paq r?) P(t”) , (3.9) 


where p is the Weyl vector of sI(N). As in Appendix B.1.6, this pairing C, ;[X] Sw x 
Cg LX 1°" > C4, can be defined by transforming the holonomy Tr (X) along the 
(1, 0)-cycle in one solid torus to the holonomy Tr (Y) along the (0, 1)-cycle, and 
it acts on loop operators in the other solid torus via the polynomials representation 
when they link: 


LEX, g(X)] = pof Y7) - g(X) OEI (3.10) 
for f, g € Cju [X]©. In the case of SU (2), this is indeed (2.114). This can be viewed 
as a deformed version of the construction of the skein module of type Ay_ 


Sk(M3, SU(N)) = Sk(M¥, SU(N)) ® Sk(M, , SU(N)) (3.11) 
Sk(C,SU(N)) 


of a closed oriented 3-manifold M3 by using a Heegaard splitting M3 = My Uc M3. 
As seen in Sect. 2.5, the polynomial representation Y of SH can be understood as 
a deformed Skein module of a solid torus S! x D?. In (3.8), P\(X) (resp. P,,(X)) 
can be actually regarded as a basis element of the deformed skein module of one 
(resp. the other) solid torus, and the boundary partition function © glues the two 
solid tori by the S-transformation (2.89). Thus, the spherical DAHA acts on the 
left-module via the polynomial representation whereas it acts on the right-module 
via its S-transformation. As a result, the S-transformation o (%7) of the polynomial 
representation, called the functional representation, can be defined by the symmetric 
bilinear pairing, which is presented in Appendix B.2.2. 

Moreover, the relation between 3d M = 2 theory T[M3] to the 2d sigma-model 
explored in Sect. 2 becomes manifest from the fivebrane system (3.1). For the sake of 
brevity, let M3 = S} x C where C & T?. As described above, the compactification 
of the 6d theory on C with U(1)g holonomy along S! leads to 4d M = 2* theory, and 
the ¢ parameter in (3.1) can be identified with the ramification parameters (a), Yp) 
via 


tq”? = exp(—7 (Yp + i&p)) . (3.12) 


As in Fig. 3.1, we further compactify the 4d M = 2* theory onatwo-torus T? = S! x 
S} C S! xq D? to obtain the 2d sigma-model S! x I > My (Cp, SU(N)) where the 
interval I = [0, 1] is obtained by reducing along S ; C D?. The canonical coisotropic 
brane Bec arises at the boundary of the strip S! x I corresponding to the center of D? 
[129]. In addition, a boundary condition of 3d M = 2 theory at 0(S! x d D?) gives 
rise to a brane %B' at the other boundary of the strip S} x I in the 2d sigma-model. 
The theory T[S} x C] consists of three M = 2 adjoint chiral multiplets Q, O and 
® where the Neumann boundary condition is imposed on the M = 2 vector multiplet 
and chiral multiplets O and ®, and the Dirichlet boundary condition is imposed on 
the M = 2 chiral multiplet Q at (S! x 4 D7). Moreover, the form (3.4) of the refined 
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(2,0) theory of type Ayn-ı on S$! x, D? x S1x.C 


on S! xq! a Nes <C 


2d o-model S} x I> My (Cp, SU(N = 3d N =2 theory T[S} x C] on St xq D? 
S1 xg D? 
do > 
Sx Sil 


Bec B’ 


Fig. 3.1 The relation between 3d M = 2 theory T[S! x¢ C] and 2d sigma-model. A mapping 
torus S! x¢ C where the top and bottom tori are identified by ¢ € SL(2, Z) gives rise to an SL(2, Z) 
duality wall on the worldsheet of (Bec, B’)-string 


index tells us that fermions are periodic and a field W is identified along the time 
circle S! 


g Bt) ¢®@-Syp (x9 + B, z1) ~ W(x, z1). (3.13) 
The time derivative is replaced as 0, > 0, — R — J3/2 due to e~8'4-8-4/), 


U()r U)s bdry cond. 
2 0 N 


OLW e 
o 
| 
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One important lesson that we learn in this subsection is that the Hilbert space of 
a non-perturbative complex Chern—Simons TQFT on a 2-torus is the space of repre- 
sentations of the spherical DAHA at t = 1. A categorified version of this statement 
would be a relation between the category of line operators in the Z TQFT and the 
category of modules of SHi=1, 


MTC(Z) = Rep(SH,_1) . (3.14) 
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Again, we remind that here and in other places, MTC refers to a tensor category 
where some of the traditional conditions may need to be relaxed, e.g. it may have 
an infinite number of simple objects, be non-unitary or non-semisimple. (The latter 
generalization typically appears when one tries to “truncate” a category with infinitely 
many simple objects to a finite-dimensional structure.) The modular representations 
that arise from such generalizations are, in general, more delicate and interesting than 
familiar vector-valued modular forms that describe the space of genus-1 conformal 
blocks in a rational VOA. Of course, in some special cases, these more interesting and 
exotic generalizations do not arise, and MTC is a genuine modular tensor category 
in its full mathematical sense (justifying the name for generalizations as well); this 
happens in some of the examples discussed in the following subsections and also in 
various examples considered in [44, 55, 76]. 


3.1.1 SU(2): Refined Chern—Simons and TQFT Associated 
to Argyres—Douglas Theory 


This connection of 3d theories to the 2d sigma-model clarifies the geometric origin 
of the modular action. It was proposed in [4] that the fivebrane system (3.1) with 
N = 2 M5-branes gives rise to SU(2) refined Chern—Simons theory on M3 when the 
parameters are subject tot 


Ti cri 


q= p(z) ; t= exe() : (3.15) 


This condition is equivalent to the existence (2.99b) of the brane By in the 2d 
sigma-model Sect. 2.6.3 so that the field identification (3.13) under (3.15) leads to 
the boundary condition B’ = By upon the reduction as in Fig.3.1. Therefore, the 
module Hom(%8,<, By) of DAHA in the 2d sigma-model can be identified with 
the Hilbert space of SU(2) refined Chern—-Simons theory on T? spanned by {|Pj)} 
(j =0,...,k). The projective action of SL(2, Z) on the Hilbert space is mani- 
fest in refined Chern—Simons theory, and the matrix elements can be obtained via 
the 3d/3d correspondence. In fact, the pairing (3.9) at N = 2 (which is equal to 
(2.114)) becomes of rank (k + 1) when (3.15) holds; it gives the modular S-matrix in 
Conjecture 2.1 up to a suitable normalization with the Macdonald norm (2.116). 
Upon reduction to the sigma-model, it can be interpreted as the S-duality wall 
in the worldsheet of the (Bec, By)-string. Thus, the gluing of the two states 
A, p € Hom(8,., By) by the S-duality wall in the (8,., By)-string can be under- 
stood as the Hopf link configuration in refined Chern—Simons theory on S°, illustrated 
in Fig. 3.2. 


4 The parameters (dours, fours) in this paper are related to the parameters (qas, tas) in [4] via qour = 
1/2 1 
ne and four = tag - 
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Fig. 3.2 The 
(Bec, By)-string with the U 
S-duality wall gives rise to 
refined Chern—Simons S 
invariant of the Hopf link in 

3 


S 


Bec 

Although the parameters q and ¢ are subject to t7g* = —1, there is one free 
parameter left. If c is generic, refined Chern—Simons theory cannot arise from a fusion 
category due to Ocneanu rigidity (for instance, see [49]) and, therefore, it is not a 
modular tensor category (MTC).° Nonetheless, it provides torus link invariants as we 
will briefly review below. In addition, the half index in (3.8) provides the deformation 
of WRT-invariants of the lens space L(p, 1), and moreover Zriwp.od: t) in (3.7) 
exhibits positivity [75, 76]. Despite the failure to be a fusion category, the half indices 
shed new light on the topology of three-manifolds and link invariants via the 3d/3d 
correspondence. 

The relation between a 3d theory and Conjecture 2.2 is more interesting. It was 
argued in [116] that the field identification (3.13) under the condition tq! = 1 
is equivalent to the class S construction for the Argyres-Douglas theory of type 
(Ay, Aze—1y) in [39, 155], which we briefly review below. The 4d N = 2 Argyres— 
Douglas theory of type (A1, A2œ-1)) can be geometrically engineered by compacti- 
fying two M5 branes on a sphere C = CP! with one wild (irregular) singularity at 
infinity. The theory is specified by the Hitchin system on Cwi where the Higgs field 
has the asymptotic behavior at infinity described by 


2é-1 


p(zi)dz1 ~ zı” o3dz1 , (3.16) 


where z; is the coordinate of C\\oo and 03 is the third Pauli matrix. Thus, we denote 
this Argyres—Douglas theory by 7 [Cwia, SU(2)]. The Hitchin action on the moduli 
space of Higgs bundles can be identified with the U(1)g symmetry defined below 
(3.4) 

U(1)s : (A, p) > (A, ep). 


In the brane setting (3.1), we cannot consider the Hitchin system with (3.16) on D? 
in general. However, when the Q-deformation parameters are subject to t7g7“! = 1, 


the field identification (3.13) for the Higgs field is consistent along the time circle S! 


5 If we further impose the condition that q is a root of unity, the 3d theory on M3 becomes an MTC 
[101]. 
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2-1 
tq = p(xo + p, z1) = pro + 8, z1) ~ pxo, z1) - 
Hence, under (2.99c), it is effectively equivalent to the following brane setting: 


space-time: S! x T*Cwia x T*M3 (3.17) 
2MS5-branes: S! x Cwi X M3 : 
This system is investigated in detail (including Argyres—Douglas theories of other 
types) [44, 58, 59, 116], and remarkably there turns out to be an SL(2, Z) represen- 
tation on the set of connected components of U(1), fixed points 


SL(2, Z) C (components of U(1), fixed points in M p (Cwita, G)) ; (3.18) 


Moreover, considering the topologically twisted partition function Z(S! x M3) of 
the Argyres—Douglas theory T[Cwia, SU(2)], this SL(2, Z) representation can be 
categorified. Namely, there is a modular tensor category MTC[A,, Aze_1)] on M3 
whose simple objects are in one-to-one correspondence with U(1), fixed points. 
In fact, the Argyres—Douglas theory of type (A1, A2œ-1)) possesses the discrete 
global symmetry Z2;,1, and if we impose a holonomy q = eit (Y € Zy,,) of 
this discrete global symmetry along S!, then the modular matrices in Conjecture 2.2 
are those of the corresponding MTC[A, A2œ-1)] on M3. Although the S and T 
matrices in Conjecture 2.2 satisfy the PSL(2, Z) relation even for a generic q, the 
Ocneanu rigidity again forbids them to be those of an MTC. Rather, they connect 
MTC’s for different values of a holonomy q = eo with y € Zy,,, by the one- 
parameter family with q. 

When y = 1, the modular matrices coincide with those of the (2, 2€ + 1) Virasoro 
minimal model [44, 116]. Note that the (2, 2@ + 1) Virasoro minimal model is the 
chiral algebra of the Argyres—Douglas theory of type (A1, A2œ-1)) [40]. However, the 
topologically twisted partition function Z(S! x M3) (therefore MTC[Aj, Axe—1)]) 
receives the contribution from Coulomb branch operators whereas a vacuum char- 
acter of the chiral algebra is given by Higgs branch operators [23]. It is worth noting 
that there are generally many chiral algebras with the same representation categories 
[55] so that this coincidence remains very mysterious. (It is sometimes called “4d 
symplectic duality”.) 


3.1.2 SU(N): Higher Rank Generalization 


Let us briefly consider a higher rank generalization of the 3d modularity. The moduli 
space of Gc flat connections over a two-torus C = T? is the quotient space (Tc x 
Tc)/W of the product of the two complex maximal tori by the Weyl group. In 
particular, when Gc = SL(N, C), the fixed points under the action of the Weyl group 
W = Gy consist of the center Zy x Zy C Te x Tc so that there are N? torsion 
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points on the moduli space V := (T x T)/Gy of SU(N)-bundles over a torus. For 
higher ranks, tame ramifications of Higgs bundles are classified by Levi subgroups of 
SU(N) or equivalently partitions of N [84]. To obtain the spherical DAHA SH (Gy) 
of type Ay_; as Hom(Bec, Bec), a simple puncture corresponding to the [1, N — 1] 
partition needs to be introduced on C. Although we have not understood topology 
and symplectic geometry of the Hitchin moduli space M(C,, SU(N)) over a torus 
with a simple puncture (for instance, the number of irreducible components of the 
global nilpotent cone), we can generalize Conjectures 2.1 and 2.2 to the higher ranks. 
It is a very interesting problem to generalize the analysis in this paper to arbitrary 
semi-simple gauge groups. 

In refined Chern—Simons theory with SU(N) gauge group [4], the parameters q 
and ź are usually expressed in terms of a positive integer k € Z. and the continuous 


parameter c: 
= ( Ti ) mE ( cri ) (3.19) 
tee) ee 


so that they are subject to the relation 1” q* = —1. Under this condition, the moduli 


space V of SU(N)-bundles is a Lagrangian submanifold in the symplectic mani- 
fold (M(C,, SU(N)), wx). As in the A; case, finite-dimensional representations in 
the higher rank spherical DAHA SH (Gy) can be studied by using the raising and 
lowering operators [105] in the polynomial representation Y. The Hilbert space 
Hom(8.-, By) of SU(N) refined Chern—Simons theory is spanned by the basis P) 
labeled by Young diagrams A C [k%~'] inscribed in the k x (N — 1) rectangle. The 


modular action on the Hilbert space is described by S and T matrices of rank a ; 


oe = Lypyj2— 2 Hii 
Wane E N e Tsa A a 


where ||A]|? = > ?, and à’ denotes the transposition of the Young diagram À. They 
indeed compute invariants of a Seifert manifold and a torus link [4, 36, 37]. Regarding 
P(X) as an element of SH (Gy), one can define the invariant of a torus link 7,,,,, by 


Waa BED Caes (” J € SL(2,Z). (3.21) 


where Cm,n acts projectively on P\(X) € SH (Gy), and @: SH (Gy) — C,,; is the 
evaluation map defined in (B.18). The large N limit is conjectured to be equal to the 
Poincare polynomial of the HOMFLY-PT homology of a torus link up to a change 
of variables when colors are labeled by a rectangular Young diagram. 

After a simple puncture is added on a two-torus T?, the moduli space becomes 
smooth and the N? torsion points turn into the corresponding N? exceptional divisors. 
Let us denote them by ip (i =1,..., N?). They become Lagrangian submanifolds 


with respect to wx when tY = q~™, or 
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2ri ; 2cri (3.22) 
= exp | ——_—__] , = exp | ——_—__] , . 
4 =P et eN P\ M+eN 


with coprime (M, N). In fact, under the shortening condition t™ = q~™, there are N? 


irreducible SË (Gy )-modules of dimension aaa corresponding to the excep- 


tional divisors. Among them, only one irreducible component py? is invariant under 
PSL(2, Z), which is analogous to D; in the A; case. We are ‘terested in the modular 
matrices acting on the corresponding finite-dimensional representation of SH (Gy). 

With the shortening condition t" = q~™, a finite-dimensional module arises 
as a quotient of the polynomial representation whose basis is spanned by Mac- 
donald polynomials P, with A C [M^7!}] inscribed in the M x (N — 1) rectangle. 
This decomposes into N irreducible modules, and the other N(N — 1) irreducible 
modules can be obtained by their orbits under the symmetry © x PSL(2, Z) = 
H'(C, Zy) x PSL(2, Z) of SH(Gy). They correspond to Hom (Bec, By). From 
the brane perspective, the support of the brane of the polynomial representation 
intersects with the corresponding N exceptional divisors. When +" = q~™, N Mac- 
donald polynomials P\o (i = 1,..., N) of type Ay_1, where A® C [M7}], are 
degenerate at each eigenvalue of the Dunk] operator 


i tX; —t7! x; 


Dw) = X (uW D , D = 5 I] =x, (yr =0,1,...,N). 
r=0 IC[1,...,N] iel 
[Il=r jH 


Here we write variables of the Macdonald polynomials defined in Appendix B.1.5 as 
X;/Xj; := X°“ foraroot a = e; — ej and the q-shift operators act as @ Xj; = q% Xj. 
We also note that D® = 1 = D), Out of the N irreducible finite-dimensional 
modules, only one irreducible representation becomes a PSL(2, Z) representation, 
and its basis is spanned by 


N 
5 Pio (X)/Pxo | . (3.23) 


= AM CLMN-!] 
i= 


N+M-D! ©: 
O DIMIN with the 


shortening condition t" = q~™. As in the A, case (2.125), we can make a change 


of basis to (3.23) to obtain a apart dimensional PSL(2, Z) representation on the 


irreducible SH (Gy )-module explicitly. 

By a similar argument to the one above, the fivebrane system (3.1) at t" = q7 
is equivalent to the Argyres—Douglas theory of type (Ay_1, Am-1) [39, 155] on 
S! x M3, which admits a class S construction with an SU(N) Hitchin system on 
CP! with a wild singularity at z = 00 where the eigenvalues of the Higgs field 
grow as |y| ~ |z”/"dz|. Therefore, the modular matrices acting on the module 
Hom(B¢c, By) can be understood as those of an MTC[Ay_j, Aw_1i] associ- 
ated to the (Ay_1, Ay—1) Argyres—Douglas theory, which categorifies the SL(2, Z) 


In fact, the modular S-matrix S),, in (3.20) becomes of rank 


M 
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action on fixed points of the U(1)g action on the corresponding wild Hitchin moduli 
space [58]. As a higher rank generalization of Conjecture 2.2, it is expected that they 
are related to the modular matrices in the (N, M + N) minimal model of the Wy- 
algebra, which is the chiral algebra of the (Ay_1, Am-1) Argyres—Douglas theory 
[40]. In fact, by normalizing them appropriately with the Macdonald norm (B.15) 
of type Ay_1, the modular matrices at q = e~?™'/™+) coincide with those (3.26) 
of the Wy(N, M + N) minimal model [20], which are reviewed below. However, 
we should keep in mind the same caution as the one given at the end of the previous 
subsection Sect. 3.1.1. 

Remarkably, the space Hom (Bec, By) has another intriguing interpretation. In 


the limit of the spherical rational Cherednik algebra SH (6 n), the target space 
of the sigma-model becomes the Hilbert scheme of (N — 1)-points on the affine 
plane C?, and the exceptional divisor bp”? only remains to be a compact Lagrangian 
submanifold, called punctual Hilbert scheme. (See also Appendix D.2.) It is known 
that its geometric quantization provides the unique finite-dimensional representation 
of SH (6 N) (14, 78, 79] and it is furthermore isomorphic to the lowest a-degree 
Hoottom (Ty, m) of HOMFLY-PT homology of the (N, M) torus knot Ty, m [73]. Thus, 


we have an isomorphism of vector spaces 


K°(MTC[Ay-1, Am-1]) = Hom(B ec, Bpm) = Avottiom(Ty,m) - (3.24) 


In what follows, we briefly review the modular matrices of the Wy(NV, M+ N) 
minimal model [20]. These minimal models admit a coset description: 


_ SU(N), x SU(N); ON 
Wy(N, M +N) = on. with k= 37N. 68-25) 


Therefore, their modular matrices are constructed from those of SU(N); affine Lie 
algebra [20]. The primary fields in the SU(N), WZW model are classified by 


N-1 
P(N: n) TE Aner) € 285" | TA <n=k+N] 


i=l 


where the vacuum corresponds to @ = (1,..., 1) € ®(N; n), and the S matrix is 
given by 
ae 1 t(A)t ALE 
so z= E a ) det expl—2ni ALE Vara) Jul ) 
d iny N Nn n 1<¢,m<N 


with 


N-1 
a= D> AD, tO) := 0 jA;. 
j=l 


i<l<N 
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The primary fields of the Wy(N, M + N) minimal model are in one-to-one corre- 
spondence with the following set 


O[Wy(N, M+N)] = fo. dN) |A€ O(N; N+M), t(4)=0 mod n} 


The modular $ and T matrices of the Wy(N, M + N) minimal model are 


3-N toC) + tA) ; ; 
E ET 2% exp] 7E a SONIN EM) g (N4M)/N) 


m ee ate NX)- (N+ M)o— NA) 
(0,A)(o,p) = Au EXP (N + M)N 


(3.26) 


where the inner product is defined by 


N — N — 
A-p= X ANN ~p ^it = a unt ye) 


1<i<N l<i<j<N 


3.2 Relation to Skein Modules and MTC[M3] 


In the above discussion, we already encountered the skein modules of 3-manifolds 
and the algebraic data of line operators MTC[M3, G] in3d.N = 2 theory T[ M3, G], 


MTC[M3, G] := Line[T[M3, G]] 


that also enters “gluing” of vertex algebras associated to 4-manifolds [55], twisted 
indices of 7 [M3, G] on general 3-manifolds [76], and modular properties of q-series 
invariants Z(M3) [32]. 

Since 3d theory T[M3, G] has only V = 2 supersymmetry, it cannot be topolog- 
ically twisted on a general 3-manifold and, therefore, does not lead to a full 3d TQFT 
that could have been associated to a tensor category (of its line operators) in a famil- 
iar way. Nevertheless, as was pointed out in [76], the structure of line operators and 
partially twisted partition functions in T[M3, G] in many ways is close to (and, in 
some cases, is described by) that of a tensor category. Hence, the name MTC[ M3], or 
MTC[Msz, G]. The simple objects of MTC[M3, G] are complex Gc flat connections 
on M3. For example, when M3 is the Poincaré sphere and G = SU(2), there are three 
simple objects in MTC[M3, G] and K°(MTC[M3, G]) has rank 3. In this example, 
and more generally, when all Gc flat connections on M3 are isolated, they can be 
identified with the intersection points of two Heegaard branes $ y+ associated with 
the Heegaard A pOL of M3, illustrated in Fig. 3.3. 

Specifically, let M3 = Mj Uc M3 be a Heegaard splitting of a closed oriented 
3-manifold M3. As in (2.85), 3-manifolds with boundary OM; = C define the 
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Bae Maat (C, Ge) 


Fig. 3.3 A Heegaard decomposition (left panel) of a closed oriented 3-manifold leads to an inter- 
pretation of K°(MTC[M3]) as the space of (8 y+, 8 y-)-strings in Mpat(C, Gc) 


(A, B, A)-branes y+ supported on Lagrangian submanifolds Mat(M3z, Gc) in 
Maa (C, Gc). Hence, K°(MTC[M3)]) can be interpreted as the space of open strings 
between two Heegaard branes By=+ associated to M3 and illustrated in Fig. 3.3. 
Furthermore, via a complex analogue of the Atiyah—Floer conjecture (see e.g. 
[81]), this ring is expected to be isomorphic to the complex Gc Floer homology 
H F? (M3, Gc) of M3: 


K°(MTC[M3]) = Hom? (B 7+, B y-) = HF™ (Maa(C, Gc); Ht, H7) = HFP (M3, Gc) . 

(3.27) 
Here both symplectic and instanton Floer homology groups are Z-graded, and we 
take the zeroth degree of the homology groups. Physically, this grading comes from 
non-anomalous U(1) R-symmetry. 

Indeed, the relevant system here is a stack of M5-branes on R x T? x M3, and we 
are interested in the Hilbert space H7,y,.72,G]. We can interpret this Hilbert space as 
that of 3d. M = 2 theory T[M3, G] on T?. The Hilbert space is Z-graded by the U(1) 
R-symmetry of the 3d M = 2 theory. On the other hand, we can compactify the 6d 
N = (2,0) theory on T?, and perform the topological twist of the 4d V = 4 theory 
considered in [157]. The two types of topological twists of the 4d M = 4 theory in 
[157], Vafa-Witten twist [150] and Marcus/GL-twist [117, 123], are equivalent on 
R x M3, and the BPS equations on M; are satisfied by complex Gc-flat connections. 
As a result, the Hilbert space can be understood as complex Floer homology of M3. 
Consequently, the Hilbert space admits two interpretations [76]: 


Hrir:,c (M3) = Hr w,x72,G) = HTim,G] (T°) . 


In general, complex Floer homology groups are infinite-dimensional due to the pres- 
ence of reducible solutions and non-compactness of moduli spaces. Nonetheless, it 
is graded by the R-charges of the 3d M = 2 supersymmetry, and we expect that the 
zeroth degree piece gives precisely (3.27). 

Note, that for some manifolds, like M3 = T°, all complex flat connections are 
reducible. (In this example, simply because 7 (M3) is abelian.) Such examples illus- 
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trate especially well how the infinite-dimensional complex Floer homology of M3 is 
re-packaged into its finite-dimensional version K 0 (MTC[M3, G]). Moreover, half- 
BPS line operators in 7 [M3, G] are in one-to-one correspondence with states of the 
Hilbert space of T[M3, G] on T?. The mapping class group of T? acts on this Hilbert 
space, justifying the name for K°(MTC[M3]). In practice, this can be a log-modular 
action, as in [32]. 

A somewhat similar “regularization” of the complex Floer theory is provided by 
the skein module Sk(M3, G), which was recently shown to be finite-dimensional 
[67] for any closed oriented 3-manifold M3. Physically, the SU(N )-skein module of 
M; is a set of all formal linear combinations of line operators in complex SL(N, C) 
Chern—Simons theory, defined as [135, 143]: 


Sk(M3, SU(N)) = C[g*] (isotopy classes of framed oriented links in M3)/skein relations . 


where the skein relations are given by 


rx - qe x eee » C 


The analogue for Cartan types other than A is not well explored, and would be an 
excellent direction for future work. 

Focusing on G = SU(N) and Gc = SL(N, C), the above discussion suggests 
that there may be a relation between K 0(MTC[M;, G]) that describes line operators 
in TJ [M3] and the skein module Sk(M3, G). This relation cannot be a simple isomor- 
phism because, e.g. for M3 = T? and G = SU(2), K°(MTC[M3, G]) has 10 simple 
objects whereas rank Sk(M3, G) = 9 [30, 65]. Relegating a better understanding of 
this relation to future work,° here we merely conjecture that it commutes with the 
SL(Q, Z) action, so that Sk(M3, G) also enjoys a (possibly, log-) modular action 


SL(2, Z) C Sk(M3, G). 


6 The above mentioned examples of the Poincaré sphere and M3 = T? suggest that the general 
relation for G = SU (2) might be rank Sk(M3, G) = rankK°(MTC[M3, G]) — 1. Although we do 
not know any counterexample to this potential relation, we should stress that the role of “—1” is 
likely to be delicate and can not be simply attributed to, say, reducible flat connections (as in the 
case of the Poincaré sphere). For example, in the case of M3 = T?, all complex flat connections 
are reducible, as was already pointed out in the main text. 
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As a next natural step, we now turn our attention to a relation between the skein 
algebra Sk(C) of a Riemann surface C and line operators of the 4d M = 2 theory 
T[C], in particular in the case when C is a (punctured) torus. 
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Chapter 4 A) 
4d Theories, Fivebranes, and M-Theory geac 


In this section, we study line operators in the 4d M = 2* theories. A 4d N = 2 
theory of class S arises from a compactification of 6d M = (2, 0) theory on a once- 
punctured torus C. The spectrum of line operators in the theory depends on additional 
discrete data, a maximal isotropic lattice L C H'(C, Z(G)) where line operators 
must be invariant under the discrete group L. Therefore, we will show that a non- 
commutative algebra of line operators of a 4d NV = 2* theory on S! x R x, R? 
with the Q-background is the L-invariant subalgebra of spherical DAHA. Also, we 
give an explicit geometric relation between Hitchin moduli spaces and an elliptic 
fibration of the Coulomb branch of a4d M = 2* theory in the rank-one case. Besides, 
we include a surface operator of Gukov—Witten type in the story, and consider an 
algebra of line operators on a surface operator to realize the full DAHA instead of 
the spherical DAHA. An advantage of the fivebrane system of class S is that we can 
relate line operators of a 4d theory to boundary conditions of a 2d sigma-model by 
a compactification. Taking this advantage, we propose a canonical coisotropic brane 
Bon of higher rank which realizes the full DAHA as Hom(B... Bec). 


4.1 Coulomb Branches of 4d VV = 2* Theories of Rank One 


In this subsection, we study a stack of M5-branes on C x S$ 1 x R?. A 4d N =2 
theory of class S is constructed by a compactification of the 6d (2, 0) theory of type 
G (G is of Cartan type ADE) on a Riemann surface C [62, 70] (generally with 
punctures) with additional discrete data L [141] (see also [64] where such choice is 
referred to as a “polarization on C”), denoted by T[C, G, L]. The basic information 
of a theory of class S is encoded in a Hitchin system 


x — > T*C 
l ; (4.1) 
C 
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where © is a Seiberg-Witten curve. The Coulomb branch of the theory on R*, 
called the u-plane, is an affine space 6, = Diz H %C , K a dt ) where the exponents 
dą depend on G. Given a point u € B,, the Seiberg-Witten curve X is expressed 
as the characteristic polynomial det(xdz — p) = f(x, u(z)) where x, z are local 
coordinates of the fiber and base of T*C. To introduce the additional data, we pick 
a symplectic basis of Hı (C) of C of genus g in terms of intersection numbers 


(a1, ..-, Qg, B1» --- Bg) €M(C), ay-aj =0= ĝi: bj, ai: Bj = ôij = —Gj- Qi, 


which yields a symplectic lattice (H!(C, Z(G)), w) where Z(G) is the center 
of G. In fact, the additional data are given by a maximal isotropic sublattice 
L c (H!(C, Z(G)), w), and they specify an allowed set of charges of line opera- 
tors that are compatible with the Dirac quantization conditions [6]. Given a maximal 
isotropic sublattice L C (H! (C, Z(G)), w), the Coulomb branch Mc(C, G, L) of 
the T[C, G, L] theory on S 1 x R? admits an elliptic fibration over the u-plane B,, 
[69, 141] 
mw: Mc(C, G, L) > B,. 


This is sometimes called the Donagi-Witten integrable system of class S. In fact, 
H'(C, Z(G)) freely acts on the Hitchin fibration m : My(C, G) > By fiberwise, 
and the Coulomb branch can be obtained by the quotient of 7: My(C, G) > By 
by a fiberwise action of L so that 


Mc(C, G, L) = My(C, G)/L. 


Note that this action can be obtained by twists of a Higgs bundle by a flat Z(G)-bundle 
over C associated to L, and it acts freely on a generic fiber of the Hitchin fibration. 
Therefore, the Coulomb branch M¢(C, G, L) inherits a hyper-Kahler structure from 
the Hitchin moduli space M y (C, G). 

Of our interest are certainly the class S theories of type A, associated to the once- 
punctured torus C,, namely 4d N = 2* theories of rank one [47, 71]. The lattice 
H'\(C p, 22) = Z2 ® Z2 with the natural symplectic form can be identified with the 
electric and magnetic charges of line operators of the M = 2* theory wrapping S!. 
Line operators with charges À = (Ac, Am) and v = (Ve, Vm) Must be subject to the 
Dirac quantization condition 


WA, V) = AeYm — AmVe € 2Z. 


There are three ways to pick a maximal isotropic lattice, corresponding to (0, 1) (1, 0) 
and (1,1)€ H! (Cp, Z2) = Z2 © Z2. They are known as SU(2), SO(3)+ and SO(3)_ 
gauge theories, respectively, where the theta angles of SO(3)+ differ by 27. Under 
the SL(2, Z) transformation on the complexified gauge coupling (electromagnetic 
duality), these theories are related to each other as follows: 
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SU(2) 
S ST (EA) 
TST <5 SO(3)+ a a SOG)_ es 
Ma(Cp, SU(2)) 
& al & 
Mc (Cp, SU(2)) Mc (Cp, SO(3)+) Mc (Cp, SOG)-) 
Mu (Cp, SO(3)) 
(4.3) 


Next, we study the geometry of the Coulomb branches of the 4d M = 2* theories 
of rank one on S! x R?. The Coulomb branches can be obtained by Z, quotients 
of the Hitchin moduli space M y (Cp, SU(2)) by & € E = H! (Cp, Z2) (i = 1,2,3) 
[69, Sect. 8.4] as in (4.3). The ramification parameters (Bp +iYp) at the Higgs 
field ọ is indeed equivalent to the complex mass of the adjoint hypermultiplet in 
the 4d M = 2* theory. The ramification parameter a, is the holonomy along S i 
for the U(1) flavor symmetry. Let us investigate the action of & on the Hitchin 
moduli space M y (Cp, SU(2)) at a generic ramification more in detail. As in Fig. 2.2, 
Mau (Cp, SU(2)) with a generic ramification has three singular fibers of Kodaira type 
h. As described in Sect. 2.1, the action of & on each fiber in the Hitchin fibration 
Mau(Cp, SU(2)) > By is of order two, and the action is moreover free on a generic 
fiber. Hence, an interesting part is the action on the singular fibers. Two irreducible 
components, U2;_; and Uv, in the singular fiber n~! (bi) can be understood as two 
CP!’s meeting at the north and south pole as double points. As illustrated in Fig. 2.6, 
the element é; in (2.29) acts on each irreducible component of the singular fiber 
m—!(b,) as the 180° rotation around the polar axis of CP!. Likewise, é acts on 
a generic fiber F nearby as the 180° rotation along the (1, 0)-cycle (meridian) of 
F. As we have seen in Sect. 2.6.2, the singular fiber 7~'(b,) is mapped to m~! (b2) 
by the modular S-transformation o. Therefore, in the neighborhood of the singular 
fiber 77! (bz), & acts on a generic fiber F as the 180° rotation along the (0, 1)-cycle 
(longitude) of F. Consequently, €; exchanges the two irreducible components U3 and 
U; by the corresponding rotation on the singular fiber 7~'(b2). In a similar fashion, 
T} € PSL(2, Z) maps the singular fiber m~! (b,) to the other fiber m~! (b3). Therefore, 
€; acts on a generic fiber F as the 180° rotation along the (1, 1)-cycle of F around 
the singular fiber 7~'(b3). Moreover, it exchanges the two irreducible components 
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Us and Us with additional rotation around the polar axis of CP!. The actions of é 
and &3 are obtained by the cyclic permutations of b; (i = 1, 2, 3). 

Since €; acts freely on a generic Hitchin fiber with order two, the quotient of the 
Hitchin fibration M y (Cp, SU(2)) —> By by & provides the structure of an elliptic 
fibration of the Coulomb branch. Namely, this double cover is obtained by an isogeny 
of each elliptic fiber of degree two [1, 2]. As illustrated in Fig. 2.6, €; acts on each 
irreducible component of the singular fiber 7~!(b,) by the 180° rotation so that the 
quotient by its action turns the double points pı 2 into the A, orbifold points. In fact, 
the quotient can be understood as a particular limit of the fiber of Kodaira type 14. 
Generically, the fiber of type 74 consists of four CP!’s joining like a necklace, or the 
affine A3 Dynkin diagram. The quotient is indeed the zero-volume limit of the two 
disjoint CP!’s as in Fig.4.3. On the other hand, the quotient of the other singular 
fibers m7! (b2,3) by £; identifies the two irreducible components and the two double 
points by the rotation, yielding the fiber of Kodaira type Jı. Again, the quotients 
of £ and £; are obtained by the cyclic permutations of b; (i = 1, 2,3). As a result, 
the quotient of the Hitchin moduli space M y (Cp, SU(2)) by €; leads to an elliptic 
fibration Mc — B, of the Coulomb branch with one singular fiber of type 74 at 
bi € B, and two singular fibers of type J; at bj41, bi42 € Bu [1, 2] as illustrated in 
Fig.4.1. Hence, an M = 2* theory of rank one enjoys a subgroup of SL(2, Z) that 
fixes the singular fiber of type 74. One can easily read off such a subgroup from 
(2.38) that is consistent with a duality group (4.2) of an M = 2* theory. Note that T+ 
and T_ correspond to the T and T ST elements, respectively, of the electromagnetic 
duality of the 4d M = 2* theories of rank one, which is different from the matrix 
assignment in (2.34). 

So far we have studied the Coulomb branches with generic ramification parameters 
(Xp, Bp, Yp). When Bp = 0 = Yp, the Hitchin fibration M y (Cp, SU(2)) > By 
has one singular fiber of type Jj at the global nilpotent cone, and it is easy from 
Fig. 2.1 to see the quotient by €;. For instance, at generic values of «,, the quotient 
of the global nilpotent cone by £é again leads to the singular fiber of type Iğ, but the 
volumes of D2 and D; shrink to zero in this case. Therefore, it has two A, singularities. 
Similarly, the quotient by another generator €; can be obtained by exchanging non- 
trivial exceptional divisor D3 to another one (D2 (£2) or Dg (&3)). 

As in (4.3), the moduli space M y (Cp, SO(3)) of SO(3)-Higgs bundles over Cp 
can be obtained by the further quotient of the Coulomb branch by the other generator 
of &. By the further quotient, the two irreducible components and the two A, singular 
points are identified in the singular fiber of type 74, and the quotient of each singular 
fiber of type J; by the 180° rotation of around the polar axis turns the double point into 
the A, singularity. As a result, all the singular fibers of M y (Cp, SO(3)) > By can 
be understood as the limit of a singular fiber of type J in which one of the irreducible 
components shrinks to zero as in Fig.4.2. When B, = 0 = yp, the global nilpotent 
cone is again the singular fiber of type Zğ, but it has three A, singularities for generic 
values of œ, [82, Fig. 1] (Fig. 4.3). 
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Fig. 4.1 Schematic illustration of elliptic fibration of Coulomb branch Mc (Cp, SO(3)+) > Bu 
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Fig. 4.2 Schematic illustration of the Hitchin fibration of M y (Cp, SO(3)) > By 
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Fig. 4.3 (Left) The Coulomb branch Mc contains a particular limit of the fiber of type 14 
so that there are two A, singularities. (Right) Each singular fiber of the Hitchin fibration 
Ma (Cp, SO(3)) > By with a generic ramification is a certain limit of the fibers of type [2 


4.2 Algebra of Line Operators 


It is known [69, 70] that loop operators along S! in a 4d M = 2 theory 7 (C, G, L) 
on S! x R? form a commutative algebra that is the coordinate ring @(Mc(C, G, L)) 
of the Coulomb branch holomorphic in complex structure J. Once we introduce the 
Q-background S! x R x, R?, loop operators wrapped on S! are localized on the axis 
of the (2-deformation as depicted in Fig. 4.4. Consequently, they are forced to come 
across each other as they exchange their positions, which yields non-commutative 
deformation of the algebra [12, 42, 97, 129, 134, 156]. Thus, an algebra of line 
operators of a 4d M = 2 theory on the Q-background provides the deformation 
quantization 04 (Mc) of the coordinate ring of its Coulomb branch, a.k.a quantized 
Coulomb branch. 

Now we are ready to discuss quantized Coulomb branches of the 4d M = 2* 
theories of rank one and their relation to spherical DAHA SH. Once we specify a 


on S! x Si 
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Fig. 4.4 An algebra of line operators (colored circles) in a 4d M = 2 theory becomes non- 
commutative in the Q-background S! x R x q R?, which provides deformation quantization of 
holomorphic coordinate ring of the Coulomb branch. The 4d M = 2 theory compactified on S! x S, 4 
is described by 2d A-model £ — Mc on the Coulomb branch where the boundary condition at 
OF is given by Bec. Here R? > Sj is the circle generating the (2-deformation 
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maximal isotropic lattice L C H 2(C, Z(G)), we can read off charges of line operators 
ina4d M = 2 theory subject to the Dirac quantization condition. The cases of the 4d 
N = 2* theories of rank one have been studied in detail [6, 69]. In fact, the generators 
x,y,z of SH in (2.47) correspond to the minimal Wilson (1, 0), °t Hooft (0, 1) and 
dyonic (1, 1) line operator, respectively. Therefore, it is natural to expect that the 
relations of quantized Coulomb branches to SH are as follows: 


e The SU(2) theory has line operators of charge (Ae, Am) with A. € Z, Am € 2Z, 
including a Wilson operator with the fundamental representation. Therefore, the 
quantized Coulomb branch is isomorphic to the £)-invariant subalgebra of SH 


O4(Mc(Cp, SU(2))) = SH® (4.4) 
generated by 
x=(X4+X Ye y?-1=(774+14+Y~%e. (4.5) 


The SO(3)+ theory has line operators of charge (Ae, Am) with Ae E€ 2Z, An € Z, 
including an ’t Hooft operator with the fundamental representation. Therefore, the 
quantized Coulomb branch is isomorphic to the -invariant subalgebra of SH 


O4(Mc(Cp, SO(3)4)) = SÄS (4.6) 
generated by 
x —1=(X+1+X e, y=(Y +Y ))e. (4.7) 


The SO(3)_ theory has line operators of charge (Ae, Am) with Àe, An € Z such that 
Ae + Àm € 2Z, including a minimal dyonic operator (Ae, Am) = (1, 1). Therefore, 
the quantized Coulomb branch is isomorphic to the €3-invariant subalgebra of SH 


6"(Mc(Cp, SO(3)-)) = SÄS (4.8) 
generated by 
x? —1=(X?+1+X e, z=(q!PYT!X +q!'PXT'Y)e. (4.9) 


To see the connection to a 2d sigma-model in Chap. 2, we can employ a trick sim- 
ilar to Fig. 3.1. Namely, we can compactify a 4d M = 2 theory on T? = S! x S} as 
illustrated in Fig. 4.4, which leads to 2d A-model R x Ry = © > Mc(C, G, L) on 
the Coulomb branch. Here S h C R? is the circle around the axis of the Q-background. 
As a result, the axis of the Q-background on which loop operators meet each other 
becomes the boundary O£. Therefore, the boundary OX should give rise the quan- 
tized Coulomb branch @? (Mc) so that the canonical coistoropic boundary condition 
Bec naturally shows up at OX [129]. By the state-operator correspondence, a loop 
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operator in the 4d M = 2 theory becomes a state in Hom(B¢c, Bec) up on the com- 
pactification. In this way, Bec arises from “the axis of the Q-deformation” (or a tip 
of a cigar as in [129]). 

We have seen that the SU(2) and SO(3).. theories are related by PSL(2, Z) so that 
the quantized Coulomb branches are indeed isomorphic. We expect the conjectural 
functor (1.3) exists even when X = Mc(C,, SU(2), L) are the Coulomb branches 
of the 4d M = 2* theories of rank one. Thus, we can compare the representation 
category Rep(@4% ()) of the quantized Coulomb branch with the A-brane category 
A-Brane(X, wx) of the Coulomb branch as in Chap. 2. In fact, we can construct a 
polynomial representation of a quantized Coulomb branch by using the two genera- 
tors, and finite-dimensional modules can be obtained by quotients of the polynomial 
representation under the corresponding shortening conditions. The geometry of the 
Coulomb branches is explored in the previous section, and we confirm that there is 
a one-to-one correspondence between finite-dimensional modules of the quantized 
Coulomb branch and compact A-branes in the Coulomb branch as in Chap. 2. 

For illustrative purposes, let us briefly study representation theory of the quan- 
T Coulomb branch 6*1 (Me(Cp, SO(3)4)) = SH®. As in (4. D), it is generated 
by x? and y. Consequently, the polynomial representation of SË splits into the + 
eigenspaces of the Zz action é : X > —X as the SHS: &ı -modules for generic (q, t). 
Therefore, SH® acts on Z := Cg, [XZ (resp. P= (X + X~’), [X+#12) 
under the polynomial representation, which is spanned by Macdonald polynomials 
of even (resp. odd) degrees. We can define a raising and lowering operator as in 
(2.79) with these generators 


2j fn2 2 2 
Reg hi Pre =i Do -D 4 -6 - t) 


— 1 — gir 
a a T a ww 
Toa gt ipi eee ay (q -—t)d—-t) 
jr" q? -q t? (q? — q2/t?) j 
They act on Macdonald polynomials as 
pol(Rj) - PiX; q, D = (l= 4! !1?) Piya(Xs q, t), (4.11) 
č a -DA -DU -DAA q0 
pol(L;) - P;(X; q, ©) q Zan ie DPM gh Pj_2(X; 4,1). 
(4.12) 


Thus, using these operations, we can study finite-dimensional representations as 
quotients of the polynomial representation P of SH® as in Sect. 2.6. Focusing on 
the polynomial representation of even degrees, when q is a 2nth root of unity (i.e. 
q” = = 1), the ideal (X2” + XT” — x5, — Xo) is invariant under the action of SÄS 
since the q-shift operator w acts trivially on X*?”. Consequently, the quotient by 
this ideal yields an n-dimensional finite-dimensional representation 


Fmt = PX” +X” — xn — Xon). (4.13) 
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An analogous representation can be obtained from the polynomial representation of 
odd degrees. They correspond to branes supported on a generic fiber with prescribed 
holonomy in Mc(C,, SO(3)+). Comparing (2.103) at m = 2n, the dimension is a 
half because it splits into the + eigenspaces of the Z, action £. Furthermore, when 
n is even n = 2p, we have another finite-dimensional representation because one 
lowering operator (4.12) becomes null: 


Ú, := P (P). (4.14) 


This corresponds to a brane supported on an irreducible component in the singular 
fiber m7! (b1) in Fig. 4.1. The dimension is a half of (2.107) due to the £ invariance. 
Under the condition, we have the short exact sequence analogous to (2.128) 


0> V, > Fyt > &(%) > 0. (4.15) 


This can be interpreted as a bound state formed by the branes supported on the two 
irreducible components at the singular fiber 7~!(b,) in Fig.4.1. Similarly, we can 
obtain finite-dimensional irreducible representations analogous to % in (2.113) and 
2? in (2.122) under the same shortening conditions where the dimensions are halved, 
respectively. 

Note that the deformation quantization of the holomorphic coordinate ring of the 
Hitchin moduli space M y (Cp, SO(3)) can be understood as the spherical subalgebra 
of “SO(3) DAHA”. It is isomorphic to the S-invariant subalgebra of SH 


O1(M (Cp, SO(3))) = SH® 


generated by x? — 1 and y? — 1. Since the weight and root lattices of SU(2) and 
SO(3) are related by Q(SU(2)) = P(SO(3)) c P(SU(2)) = Q(SO(3)), this is con- 
sistent with the construction of DAHA from the symplectic lattice (P @ PY, w) 
described at the beginning of Chap. 2 and the deformation quantization of the mod- 
uli space Maat(Cp, PSL(2, C)) of PSL(2, C)-flat connections. Again, we can study 
representation theory of the SO(3) DAHA from the perspective of brane quantization 
though the detail is omitted here. 

There is yet another way [115, 117] to connect the 4d V = 4 theory to a 2d sigma- 
model and to see a category of line operators in the 4d M = 4 theory. (See also [43] 
for a similar analysis in 3d.) Let us consider a line operator supported on R x pt C 
R x R? inthe 4d M = 4 theory with gauge group G. Then, the neighborhood around 
the line operator at pt € R? consists of two disks glued along with a punctured disk 
<> = CUcx C, called a “raviolo” [11, 127]. The “effect” of a line operator is 
measured by the modification of field configurations from one disk C to the other disk 
C, namely a Hecke modification. The compactification of the 4d V = 4 theory on the 
raviolo leads to a 2d sigma-model on the Hitchin moduli space M u(~<>-, G) of 
the raviolo, and a line operator gives rise to a boundary condition of the worldsheet as 
depicted in Fig. 4.5. It was shown [117] that a Wilson operator provides a boundary 
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2 | = s 
<> 


Fig. 4.5 (Left) The neighborhood around a line operator at pt € R? is a “raviolo”. (Right) A line 
operator (blue) gives rise to a boundary condition in the 2d sigma-model upon the compactification 
of the 4d M = 4 theory on the raviolo 


condition of type (B, B, B) whereas an °t Hooft operator gives a boundary condition 
of type (B, A, A) in My(—<>-, G). Since a boundary condition for a Wilson 
operator is holomorphic (B, B, B) in every complex structure on M g (<>, G), 
its fusion with another line operator preserves all supersymmetry. Taking into account 
the fact that the fusion of a Wilson and an ’t Hooft operator leads to a dyonic operator, 
a dyonic operator hence gives rise to a brane of type (B, A, A) in 2d sigma-model on 
Mya(—<>, G). Thus, upon the compactification, line operators in the 4d NV = 4 
theory all become B-branes of type J on M g (<>, G), and an algebra structure 
can be defined by the convolution product of B-branes. 

To formulate this idea into a mathematical model [16, 63, 146], let us first con- 
sider the moduli space of G-bundles over the raviolo. Since the coordinate ring of 
C is the formal power series ring @ := C[z] and that of C* is its field “ := C((z) 
of fractions, the moduli space of G-bundles over <>- can be expressed as a dou- 
ble coset model, namely the space GE := Gc((z)) of transition functions over the 
punctured disk C* modulo the spaces of gauge transformations GE := Gc|z] over 
each C: 


Bung(~<>-) = GE\ GE /GE . 
(4.16) 
In fact, if we take only the right quotient by the gauge transformation, the resulting 
space Gr(Gc) := G /GE is called the affine Grassmannian. 
To consider the Hitchin moduli space, we need to introduce the Higgs field. This 
can be achieved by considering the affine Grassmannian Steinberg variety 


R= {(x,[g]) € ge x Gr(Gc) | Adz- (x) € gé). (4.17) 


The quotient GE \R is the moduli space of a pair of G-bundles and sections of its 
adjoint associated bundle over the raviolo, which can be regarded as the mathematical 
model of M y (<>, G). Taking the B-model viewpoint in complex structure /, 
the category Line of line operators in the 4d M = 4 theory with gauge group G and 
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zero theta angle is equivalent to the derived category of GE -equivariant coherent 
sheaves on R 7 
Line[T[C, G, L]] = D’Coh% (R), 


where a maximal isotropic lattice L is chosen in such a way that the theta angle is 
zero. For instance, it is easy to see that it automatically incorporates the category of 
Wilson operators as 


Coh (pt) = Coh (pt) = Rep(G). 


By taking the Grothendieck ring of this category, we obtain the algebra of line 
operators in the 4d NV = 4 theory [16] 


K% (R) S CITe x TXI, (4.18) 
which is indeed isomorphic to the coordinate ring of the Coulomb branch 


Te x Tg 


Mc(C, G, L) = W 


(4.19) 


of the 4d VV = 4 theory on S! x R? holomorphic in complex structure J [16, 63, 
146]. The coordinates C[Tc]” and CITY ] are spanned by Wilson and ’t Hooft 
line operators, respectively. It is important to note that the Coulomb branch is not 
isomorphic to the moduli space Maa(C, Gc) of Gc flat connections on a two-torus 
C = T? in (B.6) as a holomorphic symplectic manifold. It is rather a quotient of 
Maa(C, Gc) by L. 

To obtain the algebra of line operators in the 4d NV = 2* theory, we turn on the 
equivariant action C% on the cotangent fiber of the affine Grassmannian Gr(Gc), 
which is equivalent to switching on the ramification parameters (3.12). Moreover, 
its quantization can be further achieved by introducing the equivariant action C% of 
the loop rotation z +> qz. In this way, we obtain the quantized Coulomb branch of 
the 4d M = 2* theory on S! x R? 


K GE xCA)HCy RZ SH(W)'. (4.20) 


As we have seen in the examples of rank one, it is not isomorphic to the spherical 
subalgebra SH (W) of DAHA associated to W. It is rather the L-invariant subalgebra 
of SH(W). 

Even with the same gauge group G, discrete theta angles provide different theories 
as in the examples of rank one. Generally, they are distinguished by characteristic 
classes of Higgs bundles such as the Stiefel- Whitney classes wz and w4 [6, 61]. Above 
we consider only the cases in which the theta angle is zero, but we can generalize it 
to a theory with non-trivial discrete theta angle by constructing the moduli space of 
Higgs bundles with non-trivial topological classes over the raviolo. 
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4.3 Including Surface Operator 


So far, we focus on physical realizations of the spherical DAHA SH (W) and its 
subalgebras, and it is natural to ask whether we can realize DAHA H (W) itself. To 
see that, let us consider an algebra of line operators on a surface operator of Gukov— 
Witten type [84]. A surface operator of Gukov—Witten type arises as an intersection 
of M5-branes at codimension two locus: 


space-time: R4 x T*C x R? 
N M5-branes: R4 x C x pt 
(surface operator) MS5’-brane: R* x C xR? 


where C = T? is a two-torus. Here a surface operator is supported on R? x pt c R4 
in the V = 4 SU(N) theory T[C, SU(N), L]. A half-BPS surface operator breaks 
the gauge group down to a Levi subgroup L C G, and as in (2.4) the singular behavior 
of the gauge field around the surface operator is 


A=adt+---, (4.21) 


where z = re!” is a local coordinate of the plane normal to the surface operator. The 
singular behavior for one ® of the adjoint chiral scalars is described by 


D;® = (B + i7)6(z, Z). 


A surface operator can also be microscopically realized as a 2d NV = (4, 4) theory 
coupled to the 4d M = 4 theory where the triple (a, 3, y) can be understood as the 
N = (4, 4) Fayet-Iliopoulos parameters. In addition to the triple (a, 8, y), they are 
also labeled by the theta angles ņ of the 2d theory. The quadruple (a, (3, y, 7) takes 
a value in the W,-invariant part of T x t x t x TY where we write Wz for the Weyl 
group of the Levi subgroup L. We remark that surface operators exist in NM = 2 
supersymmetric gauge theories where the parameters 8 and y are absent due to the 
number of supersymmetry. 

In the following, we consider a category and algebra of line operators on a surface 
operator that breaks the gauge group G to its maximal torus T, which is often 
called the full surface operator. In this case, the corresponding Weyl group is that 
of the gauge group Wr = W. Since we will eventually consider the 4d M = 2* 
theory, we set 8 = 0 = y and the surface operator is parametrized by the pair (œ, n). 
As in the previous subsection, we can study this by compactifying the 4d theory 
on the “raviolo”. However, due to the presence of the surface operator, there are 
ramifications at the centers of the two disks of the raviolo —<>— around a line 
operator (Fig. 4.6). We write the resulting Hitchin moduli space by (<>, G), and 
we are interested in a category of B-branes of type J on My (~<>—,G). 

Again, we first consider the moduli space of G-bundles over the ramified raviolo 
—<>- to formulate this into a mathematical model [146, 148, 149]. The full surface 
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on <> 
— 


Fig. 4.6 The raviolo around a line operator (blue) on the surface operator (red) has tame ramifica- 
tions at the centers of the two disks. A line operator (blue) gives rise to a boundary condition in the 
2d sigma-model upon the compactification of the 4d M = 4 theory on the raviolo 


operator breaks the space of gauge transformations on a disk from the loop group 
GE to the Iwahori subgroup 


J = [ao + aiz + azz? +- € GE lao € B} (4.22) 


that is the preimage of a Borel subgroup B under the projection GE — Gc. Hence, 
the moduli space of G-bundles over <> can be expressed as the double coset 
space 


Bung(<>-) = 4\G¢/F . 


Actually, Fl(Gc) := GE /¥ is called the affine flag variety, which is the fiber 
bundle over the affine Grassmannian with the full flag variety Gc/B a fiber 


Gc/B —> FI(Gc) 


l 


Gr(Gc) 


As a mathematical model of the Hitchin moduli space M y (<>, G), we can 
consider the moduli space J \Z of a pair of G-bundles and sections of its adjoint 
associated bundles on <>— where Z is the affine flag Steinberg variety defined as 


Z = {(x, [g]) € Lie(-%) x FI(Gc) | Adg-i (x) € Lie(.7)}. (4.23) 
Consequently, the category of line operators on the full surface operator in the 4d 
N = 4 theory with gauge group G and zero theta angle is equivalent to the derived 


category of .%-equivariant coherent sheaves on Z 


Line[TI[C, G, L], T] = D’Coh” (Z), (4.24) 
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where a maximal isotropic lattice L is chosen in such a way that the theta angle is 
zero. This includes the category of Wilson operators on the full surface operator 


Coh” (pt) = Coh” (pt) = Rep(T), 


which sees that the gauge group G is broken to the maximal torus T due to the surface 
operator. Clearly, the Grothendieck ring of the category (4.24) is the algebra of line 
operators on the full surface operator in the 4d M = 4 theory [146, 148, 149] 


K? (Z) =C[Te x TX] x C[W]. 


Unlike (4.18), this ring is non-commutative because line operators on the sur- 
face operators know the order of multiplications even without quantization (Q- 
deformation). 

By introducing the equivariant actions as in (4.20), we obtain an algebra of line 
operators on the full surface operator in the 4d M = 2* theory with gauge group G 
and zero theta angle on the Q-background 


Kee (Z) ~ Acw)'. (4.25) 


This is isomorphic to the L-invariant subalgebra of DAHA Ë (W). In the case of 
G = SU(2), this is isomorphic to the é2-invariant subalgebra of DAHA H generated 
by X, Y’, T.ForG = SO(3), itis isomorphic to the é -invariant subalgebra of DAHA 
H generated by X?,Y,T. (See Sect. 2.2.) 

Although we consider the full surface operator that breaks a gauge group SU(N) 
to S[U(1)™] here, we can instead include a surface operator of another type associated 
to a partition of N. For this, we replace the Borel subgroup B in (4.22) by a parabolic 
subgroup P associated to a partition of N. In this way, we can obtain a variant of 
DAHA as an algebra of line operators on a surface operator. 


Canonical Coisotropic Brane of Higher Ranks 


In the previous subsection, the canonical coisotropic brane 8, emerges as the bound- 
ary condition at the axis of the Q-deformation by compactifying the 4d. M = 2* theory 
on T? S S! x S 5. Moreover, an algebra of line operators can be understood as the 
algebra of (Bec, Be-)-strings in 2d A-model on the Coulomb branch. It is natural to 
ask how to describe the boundary condition at the axis of the Q-deformation in the 
presence of the full surface operator up on the same compactification (Fig. 4.7). 
For this purpose, we refer to the idea [15, 88] employed in the geometric con- 
struction of rational Cherednik algebra. Roughly speaking, spherical DAHA SË (W) 
can be interpreted as the subalgebra averaged over the action of the Weyl group W. 
We want to construct the part of the Weyl group by constructing a brane of higher 
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ones <8, 


a 
Bec 


Fig. 4.7 The 4d M = 2* theory with the Gukov—Witten surface operator on S! x s} is described 
by 2d A-model © —> Mc(Cp, G, L) where the boundary condition at OX is described by the 


canonical coisotropic brane 8, of higher rank 


rank since the algebra of line operators on the full surface operator realizes (4.25). 
In fact, there is the natural construction of the Wey] group just by taking projection 
Tc x TX —> (Tc x TX)/W. If we regard the Coulomb branch of the 4d M = 2* 
theory as the resolution n : Mc(Cp, G, L) > (Tc x TX)/W, we can define their 
fiber-product 2) via 


Y —— > Tex TX 


p 4 


Melat D n Ti 


Therefore, 2) can be understood as the universal family of Mc(Cp, G, L). Following 
[88], we define the “unusual” tautological bundle P := p,@(Q)) on Mc(Cp, G, L), 
which is called Procesi bundle, by the push-forward of the sheaf @(2)) of regular 
functions (or the trivial bundle) on 2). By construction, the Procesi bundle P has 
rank |W|, with the regular representation of the Weyl group W on every fiber. Then, 
the canonical coisotropic brane Bec := P ® Bec in the presence of the full surface 
operator is indeed the tensor product of the original line bundle £ for Bee (2.57) 
with the Procesi bundle P. Consequently, the algebra of (Bees §...)-strings realizes 
an algebra of line operators on the full surface operator 


Hom (Bec, Bec) = H(W)t. 


If we replace Mc(C,, G, L) and TX by the Hitchin moduli space M y (Cp, G) 
and Tc, respectively, in the constuction above, we obtain the full DAHA as 
End(®,.) = z= Ë (W). In particular, when q = 1, the bundle P ® £ is equivalent to 
the vector bundle E constructed in [130, Corollaries 6.1 and 6.2]. In fact, the space of 
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n n ~ 


Bec Boe Be Bee Bee Bee 


Fig. 4.8 (Bec, Bec)-strings and (Bec, Bee)-strings form DAHA Ë and spherical DAHA SH, 
respectively. Hence, a (Bees Bec)-string leads to H-left and SH -right module He 


(Bee, 8 .,)-strings can be understood as H(W)-left and SH(W)-right module H(W)e, 
to which the Procesi bundle P is associated (Fig. 4.8). 

This has the following remarkable consequence. In Chap.2, we have seen that 
given an A-brane %’, the space of (Bec, B’)-strings can be understood as a repre- 
sentation of spherical DAHA SH (W). In fact, given a (Bec, B’)-string, its joining 
with a (Bee, $8 .-)-string always yields a (Bee, $8’)-string (Fig. 4.9), which receives 
the action of the full DAHA H(W). In a similar fashion, by reversing a (Bec, B’)- 
string, one can obtain a (Bec, $’)-string from a (Bees 38’)-string. This leads to the 
Morita equivalence of the two representation categories 


Hom (Bec, Bee) : Rep(SH(W)) > Rep(H(W)). (4.26) 


Of course, not every object produces an equivalence of this type. We expect that both 
Bec and Boc can be understood as generating objects of the category of A-branes. 
In general, generating objects are far from unique, and their non-uniqueness is one 
way that Morita equivalences arise. For example, any free R-module is a generating 
object, giving rise to the usual Morita equivalences between matrix algebras. Since 


Fig. 4.9 Joining of a 
(Bee, Bee)-string and a 
(Bee, B’)-string leads to 
(Bees $8’)-string 


Bec B’ 
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A 


Bec is, in a sense, analogous to a higher-rank module over Bec, we expect a similar 
story here, but do not pursue this in this paper. 

In particular, since the space of (Bee, %8.,)-strings is associated to the Procesi 
bundle P, the dimension formula for the representation corresponding to the space 
of (Bec, Bi)-strings for a compact Lagrangian submanifold L is obtained by just 
tensoring P in (2.72) 


dim Hom (Bec, Br) = dim H°(L, P ® Bee B By), 
= |W| dim Hom (Bec, Br). 
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Appendix A 
Glossary of Symbols 


As a general rule, single symbols in sans-serif type are used to denote lattices or other 
free Z-modules. Words set in sans-serif type (e.g. A-Brane) refer to categories. Italic 
symbols may be used for groups, algebras, or other classes of objects. Calligraphic 
letters, such as M or B, denote objects which are moduli spaces or closely related to 
moduli spaces. We reserve bold-face type for distinguished Lagrangian submanifolds 
of such moduli spaces, in particular for the support of branes (such as F for a generic 
fiber of the Hitchin fibration). 

Capital gothic letters (e.g. X for the target space) are used for objects equipped 
with the structure required by the topological A-model. As such, % denotes the A- 
brane associated to particular data; for instance, By denotes a brane supported on 
the generic fiber of the Hitchin fibration. Note, though, that extra data on which the 
brane depends may be left implicit. 

Script letters will denote modules of the algebra 67 (Æ) (precisely which algebra 
is intended will be clear from the context). We always suggestively use the same 
letter for a brane and its corresponding representation, so that (for example) ¥ will 
be identified with Bp under the correspondence (1.3). 

Occasionally, we cannot help using the same symbol for different notions due 
to the lack of letters. For instance, the symbol T is used for a maximal torus of a 
compact Lie group, a generator of DAHA, a two-torus and an element of SL(2, Z). 
However, we believe that the context is a sufficient guide. 


In the following, we list notations of the paper. 


e My is a Hitchin moduli space (a moduli space of Higgs bundles), Mc is a 
Coulomb branch, M ga is a moduli space of flat connections 

e X is an affine variety over C which admits the structure of a non-compact hyper- 
Kahler manifold. Depending on context, it may be C* x C*, or the moduli space 
of flat connections with coefficients in a complex Lie group. 
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e Gis acompact gauge group, T is a Cartan subgroup of G, and L is a Levi subgroup 
of G. 

Gc is the complexification of G, Tc is a Cartan subgroup of Gc, B is a Borel 
subgroup of Gc, and P is a parabolic subgroup of Gc. 


R denotes a finite root system, and R:=R ® Zô denotes the corresponding affine 
root system. R, denotes a set of positive roots. 

Q and Q“ denote the root and coroot lattice of R, respectively. Similarly, P and 
PY denote the weight and coweight lattice of R, respectively. P} denotes the set 
of dominant weights. 

A and AY denote the character and cocharacter lattice, respectively. The center 
Z(G) and the fundamental group 7|(G) of G are given by quotients of lattices 
Z(G) = PY/AY and 7(G) = AY/QY, respectively. Their duals are Z(G)“ = 
A/Q and 7(G)Y = P/A. 


e {a1, ..., Qn} denotes the set of simple roots and {a/’, ..., a} denotes the set of 
simple coroots 

e W := (S1, ..., Sn) is the Weyl group of R where s; denotes the reflection with 
respect to a;. 

e ao := 6 — 0 with 0 being the highest short root of R so that {ao, a1, ..., Œn} is 
the set of simple roots of the affine root system R. 

owes (S0, 51, +--+» Sn) is the affine Weyl group for R. Note that we have an isomor- 
phism 

W =W x t(Q’) 


where Q“ acts by affine translation t 
t(a’)() = à — QO, a’)6. 


eW :=Wx t(P’) denotes the extended affine Weyl group, which can be expressed 


as 
W°=lIIx W 

where IT := PY /QY acts faithfully on the set of simple roots {a, a1, ..., Qn}. 

Hence, if 7,(a;) = a; for 7, € I, then T,S;7, | = sj. (See Fig. A.1.) 


Br(W), H (W), and W denote the double affine braid group, the double affine 
Hecke algebra and the double affine Weyl group associated to a Weyl group W of 
a root system. 
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a, = —1 a, =0 a,=1 a, =2 


Fig. A.1 The action of the extended affine Weyl group we of type A> with generators so, 51, 52, T. 
The reflection with respect to the axis a; = 0 is generated by s; so that s? = 1. The braid relation 
can be seen as Di) = Si+28Si+1$i+2D = Si+1Si+2S$i+1 D, which is equivalent to the reflection with 
respect to the axis a; = 1. The rotation of the triangle domain D around its center by 120° is 
generated by 7 that satisfies T? = 1. One can also convince oneself 75; = 5i+17. Here the indices 
i = 0, 1, 2 are taken to be cyclic i =i + 3. If we view the extended affine Weyl group as We = 
W x t(PY), t(w1) and t(w2) translate the domain D to sos2 D and sos 1 D, respectively, where w1, w2 
are the fundamental weights of Az 


Appendix B 
Basics of DAHA 


In this appendix, we will summarize the basics of double affine Hecke algebras. This 
appendix can be regarded as a concise review of [35, 89, 102, 122]. 


B.1 DAHA 


Let t = {to,...,t,} be a collection of formal variables associated to an affine Weyl 
group W where we identify t; = t; if the reflections s; and s; are conjugate in W. 
Note that we have at most two distinct ¢’s and, in particular, all the variables t; 
are identical for simply-laced types (A, D, E). Let q be a formal variable and let 
Clq*™ t ,---, Í ] be the ring of Laurent polynomials where m is the minimum 
positive integer satisfying (P, PY) = 1 z Z. Namely, m = 2 for type Deven; m = 1 for 
type Beven and type C; otherwise m = “Tl. We consider a multiplicative en M 


in C[q*~, t9, ..., t£] generated by elements of the form (q‘t; — q “t7 ') for any 
non-negative integer £ € Zs with i = 0,...,n. We define the coefficient ring Cy; 
to be the localization (or formal “fraction” ¢ of the ring C[q a to,.--,t, | at M: 
1 
CaS Ce r, tg, |: 


Moreover, we define C, := Cor / (qF — 1) and Cy := C4,:/(to — 1, ..., tn — 1). 
The DAHA Ë (W) associated to a Lie group G is the C, ,-algebra generated by 


elements Tọ, ..., Ta, IL, X P with relations 
1. (braid relation) 7;7;7;--- = T;T;T;--- with mj; terms on each side. (mj; is 
defined via the Coxeter relations (s;s;)’"’ = 1 in the Weyl group W.) 
2. (quadratic relation) 
T; -t)(; +171) =0. (B.1) 
© The Author(s) 2023 95 


S. Gukov et al., Branes and DAHA Representations, 
SpringerBriefs in Mathematical Physics, 
https://doi.org/10.1007/978-3-03 1-28154-9 


96 Appendix B: Basics of DAHA 


3. (first affinization) m, T;n;! = T} if m, (ai) = aj. 


4. (second affinization) For i = 0,...,n, 
T,X" = X¥T; if (u, a”) =0 
T,X" = xe if (u,av) = 1 (B2) 
where aj := —0”. 


S T,X" a! = Xr), 


The deformation parameters t; manifestly appear in the quadratic relation (B.1) 
whereas the other deformation parameter g implicitly shows up in the second relation 
of (B.2) via q = X°. The most important part is i = 0 because so(f4) = u — Ano = 
u + 6 —6 for (u, af) = 1. In this case, the relation becomes 


ToX" = XOT 1 = x" wT 1 =q ey 1 


As the name suggests, DAHA Ë (W) contains two affine Hecke algebras as sub- 
algebras: 


e (affine Hecke algebra for the root system RY) HX(W) = CTs ce Tes XP) 
e (affine Hecke algebra for the root system R) HY (W) := C; (To, Ti, ..., Tr, ID) 


where both contain finite Hecke algebra H (W) := C: (Tı, ..., Ta). Indeed, the first 
representation H* (W) is called the Bernstein presentation whereas the second one 
is called the Coxeter presentation. The second one Å Y (W) can also be expressed in 
the Bernstein presentation by using an isomorphism as vector spaces 


H(W) 8 CIY®™] 5 HW), 
where the affine translation in HY (W) is generated by Y: 


yà = Tra) if AE PY 


Y= 4) if Aap pve PY. (BA) 


B.1.1 Double Affine Braid Group and Double Affine Weyl 
Group 


The double affine braid group Br(W) is a group generated by elements Tọ, ..., Tn, 
n, xP only with the relations 1, 3, 4, 5 above (without the relation 2). In other words, 
DAHA can be understood as the C, ;-group algebra of Br(W) with the quadratic 
relation (B.1) 2 m 

H(W) = Cy [Br(W)]/ (CT; — t) T: +17"). 
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The double affine Weyl group W is Br(W) with the quadratic relations T = 1; 
Therefore, its C,-group algebra is the tf = 1 limit of DAHA Ë (W), which is also 
introduced at the beginning of Chap. 2 


C [W] = Ë,- (W). 


In the Bernstein presentation, the generators X and Y form the Heisenberg group as 
a subgroup of W with the relation 


X#Y* =q HNY`X", for peP, Ae PY. 


B.1.2 PBW Theorem for DAHA 


First of all, the following Poincaré—Birkhoff—Witt theorem for DAHA plays a very 
important role in the representation theory. Every element h € H (W) can be uniquely 
written in the form 


h = > ap, wr (h) X" TuT; au,w,r (h) E Cq.t 


rell, weW, peP 
in the Coxeter presentation for HY (W), or 


k= GRY bpw Ah) E lj, (B.4) 
AcPY,weW, peP 


in the Bernstein presentation for H YW). 


B.1.3 Spherical Subalgebra 


For w e€ W, let ty := ti ++- tipp where w = Si ---s;, is a reduced decomposition. 
Then, it is well-defined. We define an element in the group algebra C,[W] 


twTy 
e i= vew tu Tu (B.5) 


wew (tw)? 


Then, we have T;e = t;e, and it is moreover an idempotent e? = e. Subsequently, 
we can define the spherical subalgebra as SH (W) := eH (W)e cC H (W), called 
spherical DAHA. Roughly speaking, the spherical DAHA can be understood as the 
subalgebra “averaged over” the Weyl group symmetry. 

Att = 1 = q, the spherical DAHA becomes commutative 
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SH(W) — CITe x Te” 


Indeed, it is isomorphic to the coordinate ring of the moduli space 


T, Ti 
Mult Gc) = = (B.6) 


of Gc-flat connections on a torus [130]. 


B.1.4 Braid Group and SL(2, Z) Action 


The braid group on three strands is given by B3 = (T4 : T4 TIIT = TIIT TZ!), and 


the relation to SL(2, Z) is given by the short exact sequence 


1> Z> B; > SLC, Z) > 1 (B.7) 


where the kernel of the projection B3 —> SL(2, Z) is given by (rr) =]; 
DAHA H (W) receives an action of the braid group on three strands B3 = 
(TE: T4 TIIT = TIIT a), To see the action explicitly, let w;, w (i =1,...,n) 
denote the fundamental weights and coweights respectively, and we define Xji= -X ie 
and Y; = Y“ as the corresponding generators of H (W) in the Bernstein presentation. 


Then, the action reads 


X! Xt Xi be Y; Xq 
TET) OT; ; T=-34 Tj T} : (B.8) 
Y; = X; yg Ms Y^ e yA 


The element o = 7,7~'t, = 7~'7,77! maps the generators as 


X! > yor Xl Ta XA Ty, 
0: T; a T; ; o? : T; a T; ; (B.9) 
Y~“ > TT, Y` T YOT, 


where w, is the longest element of the Weyl group W. Moreover, o* acts as the 
conjugation by T„,, namely a(x) = Ta (x)Tw, for any x € H(W). 

Since T„ acts on a generator of SH (W) as the multiplication by ¢,,, the action of 
o* is trivial on the spherical subalgebra SH (W) in general: 
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Therefore, the B3 action factors through SL(2, Z) on SH (W), and each element 
corresponds to the following matrix element on SH (W)!: 


10 11 0-1 
o D) © Th, ( i} oT, é a) oo. (B.10) 


B.1.5 Polynomial Representation of DAHA 


The most basic representation of DAHA, first studied by Cherednik, is called the 
polynomial representation 


pol : H(W) > End(C,,,[X*]); 


—1 
neist- i fori =0,...,n (B.11) 


Ty 7, for el. 


Here we denote the group algebra of the weight lattice P by C, ;[X P], which contains 


the group algebra C,[X Py of the affine weight lattice P:=P@Zéasa subalgebra 
by setting X*+” := q" X^. Hence, X” act on Ca, [X P] by multiplication, and the 


action of the extended affine Weyl group W on Cg LX P], which appears as s; in 
(B.11), is given by 
w(X") := xow — gq COAX), 


where we write an element w € W° as w = t(A)v with A e PY, v e W. Note that 
the polynomial representation is faithful. 


Non-symmetric Macdonald Polynomials 
We define an involution f œ> f* for f = $, fig, pxr2 Cg LX] as 


fe eo. 
À 


We also define the weight function 


ssf] (X° a°) (1° X°; 4°) 
> (q? X9; q?) (q+? X79; q?)oo 


aeR, 


' Although we follow the notation of [35] for the transformations T+ on the generators of DAHA 
here, we change matrix assignments (B.10) to 74 from [35]. 
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Note that ca relates q and t = {fo,..., tn} via g°* = ta where cg = cg if a and 8 
are in the same W-orbit, i.e. there exists w € W such that w(a) = 2. In particular, 
there is only one parameter c for simply-laced ADE types. Then, the product (, ) 
on C,,;[X] is defined as the constant term (C.T.) of fg“ 


(f,9)=C.T.(fg*5), 


which can be taken by the integral 


dX dX, 
C.T. A(X) = eh ZOKO OG: 
IXil=1 X1 IXa@l=l Xrk(G) 


Using the product (, ), one can show the existence and uniqueness of non-symmetric 
Macdonald polynomials E(X; q, t) as follows. 
For each À € P, there is a unique polynomial E) € C,,;[X] such that 


e E, = X` + lower terms, 
e (Ey, X")=0 for“u < À. 


Under the polynomial representation, these are eigenfunctions of the Y-operators 
consequently as 
pol(f(¥))- Ey = fq) E) (B.12) 


where 


1 ifx>0 


1 ; 
pA = 5 So Aaaa with (x) = eet 


acR4 
Symmetric Macdonald Polynomials 


We define another involution f => f for f = X, Aq, t)X^ € C4, [X] as 
F=} Aa, DX. (B.13) 
À 
We also define another product [121, Sect. VI.9] on C,,,[X] as 


(X5; Po 
(fg) = ETIN where Y= Uero (B.14) 


aeR 


Since Y = Y, it is symmetric (f, g) = (g, f}. Furthermore, for a dominant weight 
à € P}, we define monomial symmetric functions 
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mM); = > X". 


HEW(A) 


Using these data, one can show the existence and uniqueness of symmetric Macdonald 
polynomials P\(X; q, t) as follows. 

For each dominant weight \ € P}, there is a unique function P, € C4, [X ]” such 
that 


e P, =m) + lower terms, 
e (Py,m,,) =0 for” € Px such that u < À, 


Under the product, the symmetric Macdonald polynomials are orthogonal. In the 
case of type Ay_1, the norm is explicitly given by 


2-H) 20} -) 1 — 2N-i+) g2G-D 


Lg 
(Pa, Px) = ôw gag.o= JI 


p, 2(AT—i+1 — £ N-i)g2j ’ 
apea 1- g ADPOTIID lt q 


(B.15) 
where we express a Young diagram A = A; > ++- > Ay_. 
Let f be a symmetric polynomial f € C4, [y?’]. Then, under the polynomial 
representation, they are eigenfunctions 


pol(f(Y1,--.,¥n))° Px = f (q) Py, (B.16) 


where is the formal expression 


p= ; > CaQ. 


aeRy 


Note that, for type ADE, it simplifies to g~**~?” = q~*\t~?? where p is the Weyl 
vector. The non-symmetric and symmetric Macdonald polynomials are related by 


the idempotent (B.5) 
P, = ( > (tw)?) eE. 


wew 


B.1.6 Symmetric Bilinear Form 


There exists an anti-involution ¢ : H (W) > H (W) fixing q, t such that 


X! pe yor 
(0) : Ly > Ty-! 
YY e xX 
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It is easy to see œ? = id. If we restrict the action of ¢ to the spherical subalgebra 
SH (W), then it is the same as ø in (B.9) 


Ol eran = Peon (B.17) 
SH(W) SH(W) 
We define the evaluation map 9 : H (W) > C4.: as 
O(h) := pol(h)- 1| (B.18) 
Xq re 


Then, one can define a symmetric C, -bilinear form [, ]. : H(W) x H(W) > Cy, 
as 
[h, h] := 0(d(A)h’). (B.19) 


In particular, for f, g € C,,[X], we have 


Lf, g] = po(f Y7) -g . (B.20) 


Xq? 


For instance, when both are symmetric Macdonald polynomials, f = P\(X), g = 
P,,(X), (B.16) tells us 


[P\(X), P (X)] = Paq") P(g"), (B.21) 


which is the refined Chern-Simons invariants of the Hopf link [4]. In fact, using the 
PBW theorem, one can bring #(A)h’ into the form (B.4) 


phh = DY uw AOM) XT Y>. 


AEPY wew,uweP 


Then, the bilinear from [ , ] is indeed expressed by 


Th RV = > yw AOH) gE ty ar, 


AcPY,weW, peP 
Since ¢ and the generators T+, T- € SL(2, Z) obey the relation øT- = T+, we have 


[r+ (h), h] = [h, T- h]. (B.22) 
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B.1.7 | Degenerations 


There is a two-step degeneration of DAHA: 


DAHA trigonometric rational 
H(W) RAS H"(W) PA H™(W) 


Trigonometric Degeneration 


Let c;, i = 0,..., be formal variables such that c; = c; whenever s; and sj are 
conjugate. We will also take commuting variables £1, ..., X, and, for u € P, we will 
denote 


= X u, avy) ij. 


The extended affine Weyl group W° acts on the space C[c, h][X1,..., X,] where 
S},...,S, acts in the standard way s;(X,) = sq) for i = 1,...,n. On the other 
hand, the affine translation involves h as t(A)(X,,) = X, — (u, A)h for A € PY. 

The trigonometric Cherednik algebra (a.k.a. graded Cherednik algebra [133] 
or degenerate double affine Hecke algebra [35, Sect. 1.6] also [140]), Atw) is 
the C[c, fi]-algebra generated by the extended affine Weyl group W° and pairwise 


commuting variables x), ..., X,, Subject to the following relations: 
Sip — Xs, Si = —Ci (u, aX), fori = 1,...,n 
S0Xp — S0(Xp)S0 = colu, OY), (B.23) 


Ty Xp = Xr, (w) Tr + 


This algebra can be obtained by taking the leading relation in the 8 expansion from 
DAHA H(W) as in Appendix B.2.3. 

Since the variables Y, ĉ are not symmetric, the algebra H ti (W) admits two poly- 
nomial representations. One is called the differential polynomial representation on 
the group algebra C[c, AJ[YP*]. The generators Y and w € W act naturally, and K 
acts via the trigonometric differential Dunkl operator 


Cal, a“) 
(ye 


DY = hd, + D> (id — sa) — (ts, pX). 


acR4 
Here the derivative ð, acts on C[c, AJ[Y] of the weight lattice PY as 
AY) = (u, NY, 


and py is the formal expression 
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pX := > Caa“. 


acR4 


The other is called the difference-rational polynomial representation on the 
group algebra C[c, fi][x]. The generator ê acts by multiplication. By defining the 
Demazure—Lusztig operators 


Ci F 
Si := Ssi + —(s; — id) 
Key 


for i = 0, 1,...,n, the action of the extended affine Weyl group W“ is given by 
Sy := Tr Si +++ Si, for W? 5 w = 7,5), +++ Si, a reduced expression. 


Rational Degeneration 


The rational Cherednik algebra H "™at(W) [14] is the C[c, h]-algebra generated by 
CIP], C[PY] and W subject to the relations 


wk =w(k)w, wh=wS)w, =A) - YO cala, S), asa 


aéeRy 


for w € W, x e C[P] and ĵ € C[PY]. This algebra can be obtained from trigono- 
metric Cherednik algebra H ti (W) by taking the leading relation in the 3 expansion 
as in Appendix B.2.4. 

The rational Cherednik algebra H rat (W) admits a polynomial representation on 
the space C[c, h][P] where x and w act in the standard way, and y is assigned to the 
rational Dunkl operator 


Q, . 
D8" := hd; — Y` as = ) did — 54), (B.24) 


acR4 


where 03(X) = (X, 3), X € P. 


Spherical Subalgebras 


We can also define spherical subalgebras of both trigonometric and rational Chered- 
nik algebras by 


SH (W):=eH"(W)e,  SH™(W) := eff (Whe, 


where e now is the trivial idempotent of the group W 
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1 
c= be. 


wew 


At c = 0 = ħ, the spherical subalgebras of trigonometric and rational Cherednik 
algebras become the commutative rings 


SH (W) cog = Cite x Tc]”,  SH™(W) p 


= C[tc x tc]”. (B.25) 
0=ħ h 


0= 


Therefore, they are the coordinate rings of the hyper-Kähler manifolds 


tc x Te tc x te 
, and P 
W W 


respectively [16] where their complex structures inherit from their elliptic origin 
(B.6). 


B.2 DAHA of Type Aı 


Now we will study DAHA H:=H (Z2) of type A; more in detail. In the case of 
type Aj, the relations 1, ...,5 in Appendix B.1 amount to 


S 1 1 1 TXT =X!, nXm! = qx", 
gh, ie we | mal, (T-1(T +1) =0f 


Here T and X generate affine Hecke algebra HX in the Bernstein presentation 
whereas T and m generate the other affine Hecke algebra HY in the Coxeter pre- 
sentation. One can write H” in the Bernstein presentation by introducing Y = aT, 
yielding another representation of Ë 


Ë = C, [T*, X+, Y 


'] TXT =X, Y !X'YXT? =q !, 
TYIT =Y, (T-)(T+t!)=0 


| . (B.26) 


In this representation, the topological interpretation using the punctured torus 
becomes apparent as we have seen in Sect. 2.2. 


B.2.1 Polynomial Representation 


The polynomial representation of DAHA of type A; 


pol: Ë > End(C,,[X*]) (B.27) 
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is explicitly given by 


t 
Trt 
ae 


(s—l), te sw, Xe X, Ye soT, 
where s is the reflection s(X) = X~', and w is the shift operator w(X) = qX. 

To study the polynomial representation, we introduce a basis of C4, [X7] spanned 
by non-symmetric Macdonald polynomials of type A, 


Xİ bi qr, t”; qH; q?; gt 7X) if j > 0 


E;(X;q,t) = j ? 
iC q,t) = api (q, t; q?it?; qÈ; t2 X?) ifj<0 


where 201 (a1, a2; b1; q; X) is the basic hypergeometric series. As we have seen in 
(B.12), they are eigenfunctions of the Y-operator under the polynomial representation 


qt E; ifj >0 


, , B.28 
gitE; if 7 <0 eee 


pol(Y)E; = | 


If we introduce a total ordering on the monomials 
PANS XO Xý y ae eR Ss, 
then they are subject to the condition 
E\(X;q,t)= X/ + lower order terms. 


The coefficients of the polynomials E; are rational functions of q and t in general. 

For generic q and t, the non-symmetric Macdonald polynomials E ; are recursively 
determined by using the intertwining (raising) operators [35, Sect. 2.6.2]. Explicitly, 
they are defined as 


t—t! 
A:= XT, B(T 75), 


and they act on non-symmetric Macdonald polynomials as 


pol(A) . Ej = pee) Bs, 
for j > 0 (B.29) 


EL; 
pol(B) - Ej = [snag E_; forj <0 i 


(rF 


In fact, these intertwining operators A, B provide an inductive procedure for calcu- 
lating the non-symmetric polynomials 
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Loh, eos, 2s es aa (B.30) 


Because of t € C%, the intertwining operator A is always invertible. Hence, in order 
to classify finite-dimensional representations, one has to understand when B is not 
invertible. Hence, as we have seen in (2.81) and (2.98), finite-dimensional modules 
arise when the factor 


ia gi) + qi) 
(= qPy 


(B.31) 


vanishes where j < 0. Then, it is easy to see that there is a one-to-one correspondence 
between finite-dimensional modules of Ë and SH because the shortening conditions 
for (2.98) and (B.31) are equivalent. In other words, for finite-dimensional repre- 
sentations, one can easily verify the consequence of the Morita equivalence (2.74) 
explicitly by the action of the intertwining operators. Therefore, the classification 
of the finite-dimensional representations of H (35, Sect. 2.8] is in one-to-one corre- 
spondence with that of SH in Sect. 2.6. 

The symmetric Macdonald polynomials P; (2.76) for j > 0 can be obtained by 
symmetrizing E+; with the idempotent e = (T + ¢~!)/(t+ 17!) 


(1 +17) eE;(X; q, 1), 


P;(X;q,t)= 231-gr (B.32) 
i 5? J eE_j (X;q,t), 
or by the combination of E; and E_j 
Pig") 


On the other hand, non-symmetric Macdonald polynomials E; can also be obtained 
from symmetric ones P; as follows. If one expresses 


j 
Pj=} cji, DË + X7), 
i=0 


then 


, j= giti 
Ej = J dji(q.t)X' where dji(q.t) = Gara gic). 


= 
i=—j 


Furthermore, one can easily determine E_j; for j > 0 from P; by (B.33). Hence, the 


polynomial representations for DAHA Ë (B.27) and spherical DAHA SH (2.75) are 
equivalent, which follows from the Morita equivalence (2.74). 
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To conclude this subsection, let us analyze how Macdonald polynomials are trans- 
formed under PSL(2, Z) transformation. In fact, under the 7_ transformation (2.44), 
non-symmetric Macdonald polynomials are subject to 


3 ; 
T(E) =q 7E}, (B.34) 


for j € Z. This can be proved by the induction in the sequence (B.30). For j = 0, 
it is easy to see that 7- (1) = 1. Suppose that g, t € C* are generic so that all non- 
symmetric Macdonald polynomials are well-defined, and (B.34) holds for E;. Since 
it follows from (2.44) that the operator B commutes with r_, E_; transforms in the 
same way as E; under 7_. For j < 0, we have 


T-(E1-;) =t !q? pol(Y XT) - T-(E;) 
induction —] _ 1 25% j 
= t q?q 7t’ pol(YXT)- Ej 
(B.35) 


2. 
"2? q?q° 70 pol); Ej 


(B.28) _G=)? 4; 
="g 2 4 t E_j. 
This completes the proof. 


Furthermore, one can show from (2.53) that the raising (2.80) and lowering (2.81) 
operators behave under the 7_ transformation as 


r_(Rj) =q 73t R;, T-(L;) = qi; 


A similar induction shows that the symmetric Macdonald polynomials are trans- 
formed as 


Po; 
T(P)) =q 7t P}, (B.36) 


which is consistent with (B.33). This formula indeed gives the modular 
T -transformation for representations of SH in Chap. 2. 


B.2.2 Functional Representation 


Here we shall give an explicit definition of the functional representation of DAHA of 
rank one [35, Sect. 2.7.1]. Restricted to the spherical DAHA SH , it can be understood 
as the S-transformation o(Y) of the polynomial representation FY of SH as in 
Sects. 2.5 and 3.1. 
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The assignment 


fo) forn > 0 


ziy 
fX) & [f(X), E,COVE(t) = f(q"t"!) forn <0 


provides the function defined only over the set Fun of X = q"en) forn E€ Z. 
Thus, one can obtain the discretization of the polynomial representation (B.27) on 
this set of functions defined over X € Fun for h € H 


dise : [f(X), En(X)I/En(t7') > [pol(h) + f, EOE». 
More explicitly, one can read off the action as 
(disc) -FIG r) =g mea fgit), 
(disc(7) . fy(qrtsene-D) — f(qi ea), 
and 
(disc(T) - fy(qrtsene-D) 
= tq?” psen) =F 


q?” t2sen(n— 3) —1 


t=! 


1 
fiqr) l fiqr ee), 


g2ng2senn—) _ 


Though g~"12"2—) is not in the set Fun when n = 0, tq?” t3®0-3) — t! = O in 
this case. Therefore, it is well-defined. 

The functional representation is defined by the symmetric bilinear form (B.19). 
If we restrict the functional representation to the spherical subalgebra SH, it is the 
modular S-transformation o of the polynomial representation due to (B.17). 


B.2.3 Trigonometric Cherednik Algebra of Type A, 


To find the trigonometric degeneration, we set X = e**, q = ef”, t = ef™ and T = 
se“ , where s € Z3 is the reflection. Then, taking the leading order in 8 from (B.26), 
the generators s, £, Y satisfy the following relations: 


s? =1, sY¥os=Y, sî +ŝs=-—2c, YY -R=hA42cs. (B.37) 


The algebra generated by s, £, Y with these relations is called the trigonometric 
Cherednik algebra H ae of type A,. It enjoys a Z)-symmetry 


iste s, XX, YR-Y, heh, cre, (B.38) 
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which is reminiscent of (2.43). The idempotent is defined by 


l+s 
e:= 


7 (B.39) 


and the spherical subalgebra is defined as SH m := eH Hie which is generated by 


vi=ex’e, and y=eYe (B.40) 


B.2.4 Rational Cherednik Algebra of Type A, 


In the trigonometric Cherednik algebra H il , we write Y = e^? and we rescale ê > 
x/@. Then, the generators s, £, ŷ satisfy the following relations 


s=l, st =—-Xs, sy=—ys, [$, y] =h+2cs, 


in the leading order of 3. The algebra generated by s, x, » with these relations is the 
rational Cherednik algebra H;™.. 


Let us study the spherical subalgebra SH. he := eH kse where the idempotent e is 
the same as (B.39). The spherical subalgebra SH ka is a C[c, h]-algebra generated by 


I 3. l AR 
E= rh e, F=-—-ey’e, H = —exye. 
with relations 


A 
[E.F]=h(H+3+c), (A E=2KE, ([H,F]=-2ħF. og gy 


4EF = H(-H+h—20). 


Thus, E£, F, H can be interpreted as the s{(2)-triple. Writing the Casimir element of 
sl(2) as 
1 h 2 
Q=EF+FE+>(H+>+0), 


it is easy to verify that there is an isomorphism [48, Proposition 8.2] 


U(sl(2))/(Q — Le + 4h)(c — 3h)) = SHE (B.42) 


Rye? 


At c = 0, the rational Cherednik algebra of type A, is isomorphic to 


Apt_, = 01C?) x CIZ], 
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where £, ĵ are the generators of G7 (C?) and s is the generator of Z2. If we consider the 
open set C* x C C C?, the deformation quantization @4(C* x C) of its coordinate 
ring is generated by x*, }. Then, we can define a subalgebra generated by 


a2 
Fis = —ckt§,  H:=—âĵ, (B.43) 


which is isomorphic to the spherical subalgebra SH. ka With generic c given in (B.42) 
with the relations (B.41). This construction indeed provides the polynomial represen- 
tation (B.24) of the spherical subalgebra of SH; acting on C[x*?] by substituting 
—h0O, for y. 


Appendix C 
Quantum Torus Algebra 


In this appendix, we study representations of quantum torus algebras and their sym- 
metrization. We aim at understanding representations of the simplest quantum torus 
algebra in terms of 2d A-model on the affine variety C* x C*. Therefore, we first 
review representation theory of the quantum torus algebra, and we subsequently find 
A-branes for two important families of representations of the quantum torus algebra: 
cyclic representations and polynomial representations. The quantum torus algebra 
and DAHA are closely related, and the relationship becomes clearer when we sym- 
metrize the algebra and representations by the distinguished outer automorphism Zp. 
Although representations of the quantum torus algebra and symmetrized quantum 
torus are rather simple, they play a helpful guide for analogous analysis for DAHA 
in Chap. 2. 


C.1 Representations of Quantum Torus Algebra 


It is well-known that the so-called quantum torus algebra is given by 


QT =C[g=\(X",Y")/Y'XYX = q`’). (C.1) 


Here the generator q is a formal parameter that commutes with both X and Y. 
This algebra occurs throughout physics, and it is indeed a close cousin of the most 
basic ingredient in the whole theory of quantum mechanics. If we allowed arbitrary 
(rather than integral) powers of X and Y, and set q = exp(27ih), it would be the 
group algebra of the exponentiated form of the canonical commutation relations. 
Here, since only integral powers are allowed, we are dealing with a discrete-valued 
analogue of canonically conjugate variables. 

In fact, QT is the group algebra of a specific Heisenberg group, associated to a 
discrete analogue of a symplectic pairing. As is well-known, the linear representations 
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of a discrete group correspond precisely to modules over its group algebra, so the 
presence of the scalars is irrelevant: studying QT-modules is the same as studying 
representations of this Heisenberg group. 

To construct it, we introduce Heisenberg groups in somewhat greater generality. 
Let S be any locally compact topological ring with characteristic not equal to two, 
and V a free, finitely generated S-module (so isomorphic to S”). A symplectic pairing 
on V is defined to be a function 


wi:VxV—S, (C.2) 


which is skew-symmetric and S-bilinear. (Note that non-degeneracy condition on w 
is not necessary here so that we use a pairing rather than a symplectic form. However, 
in all the examples we consider below, w is a non-degenerate symplectic form.) Then, 
the following is true: 


Theorem C.1 ([103, Theorem 7.1]) The group H?(V, S), which classifies group 
extensions of the additive group V, is isomorphic to the group of symplectic pairings 
on V. 


(Itis a pleasant exercise to check that any bilinear function defines an inhomogeneous 
group cochain. To obtain the full result, one shows that the antisymmetrization of any 
cochain is necessarily bilinear, and actually defines a set of unique representatives 
for the cohomology.) 

There is therefore a unique central extension of groups defined by the sequence 


0 — S > Heis(V, w) —> V > 0, (C.3) 


which is called the Heisenberg group associated to the data (V, w). In our example, 
we take S to be Z, V to be Z?, and the pairing to be defined by sending a fixed ordered 
basis of V to +1. It is then easy to see that QT is the group algebra of Heis(Z’, w), 
and that we can similarly define the quantum torus algebra 


OT (V, w) = C[Heis(V, w)] (C.4) 


associated to a general finitely generated free Z-module with symplectic pairing. In 
the sequel, OT without decoration will always refer to the standard module Z? with 
its standard pairing. 

Our algebra QT has an interesting collection of outer automorphisms: in fact, 


Out(QT) = Sp(2, Z) = SL(2, Z). (C.5) 
The inner automorphisms just consist of shifting X and Y by powers of q, and so make 


up the group Z?. The full automorphism group is a central extension of SL(2, Z) by 
this module: 
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0 > Inn(QT) —> Aut(QT) —+ Out(QT) > 0 


aĵ sî f (C.6) 


0 —> Z —> Z?xSL(2,Z) > SL(2,Z) > 0 


More generally, for the Heisenberg group on a higher-dimensional standard sym- 
plectic lattice Z?”, the group of automorphisms is the semidirect product Z*” x 
Sp(2n, Z). 

Heisenberg groups over more general rings now make starring appearances in 
numerous branches of mathematics, including even number theory [151, for exam- 
ple]. For that reason (and to highlight their connection to DAHA), we have chosen to 
emphasize the generality of the concept here even though the cases of most interest 
to everyday physics are S = R or Z. For some physical applications of the latter 
algebra in the context of Chern—Simons theory, see for example [80] and related 
work on the AJ-conjecture. 


C.1.1 Unitary Representations 


The unitary representation theory of Heisenberg groups is well-understood, thanks 
to the Stone-von Neumann theorem and its generalizations due, in particular, to 
Mackey [119, 120]. We will just quickly recall enough context to state the main the- 
orem. (This subsection is intended to mathematically classify unitary representations 
of QT so that the reader could skip to the three cases at the end for the first reading.) 
Let us start quoting the following definition: 


Definition C.2 Let G be a locally compact topological group and F a Borel space 
with G-action. A system of imprimitivity based on (G, T) consists of a separable 
Hilbert space with a unitary, strongly continuous representation of G, together with 
a G-equivariant, projection-valued measure, assigning projection operators on the 
Hilbert space to the Borel sets of T. 


The basic example of such data is the space of L? functions with respect to a 
G-invariant measure on I’; G is then represented by pull-back, and the projections 
are just characteristic functions of subsets. Actually, one can show that essentially 
all systems of imprimitivity arise in this fashion. 

The most interesting examples for physics arise when a group G is the semidirect 
product of an abelian normal subgroup A with some other group G that acts on A: 
that is, there is a split short exact sequence 


(3 AS65 6GS0b. (C.7) 


Then one chooses I to be the character space of the abelian normal subgroup A, 
with its obvious G-action. 
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Theorem C.3 The set of isomorphism classes of unitary irreducible representations 
of G is in bijection with the set of systems of imprimitivity based on (G,1), up to 
unitary equivalence. 


It is further true [145] that when G acts transitively on I’, the inequivalent systems 
of imprimitivity based on (G, T) are in one-to-one correspondence with unitary 
representations of the point stabilizer subgroup 


G,={ge€Glg-x=x} xer). (C.8) 


This means that unitary representations of G are classified by the G-orbits of T, 
together with unitary representations of the corresponding stabilizer subgroups Gx. 

For the physically minded reader, this can be understood as generalizations of 
Wigner’s technique of the little group [153]. There, the decomposition (C.7) for the 
Poincaré group is the obvious (and canonical) one, 


0 > R! > R! x SO(d) > SO(d) > 0. (C.9) 


The theorem of Stone and von Neumann is indeed an example of precisely the same 
very powerful general logic. 

To apply this technique to representations of Heis(V, w), we must choose a max- 
imal isotropic subspace L of (V, w). There is then a unique abelian normal subgroup 
AL of the Heisenberg group determined by L, which can be non-canonically iden- 
tified with L @ S. In fact, this choice defines a (non-canonical) semidirect product 
structure 

0— AL > Heis(V, w) > V/L > 0. (C.10) 


Understanding representations thus reduces to studying the (V/L)-orbits in I’. For 
simplicity, let us reduce to the one-dimensional Heisenberg group, where V = S? 
and w is the standard Darboux pairing. Then IT = SY x SY is the product of two 
copies of the Pontryagin dual of S. If we abuse our exponential notation from (C. 1) 
above, we can write an element of Heis(V, w) as g“ X'y: where a, b,c € S. Then, 
A, is the set of elements of the form q“ X’, and a splitting of the short exact sequence 
is provided by the subgroup of elements Y°. The action of V/L is then determined 
by the formula 


y= (q° x”) Y" == ore, (C.11) 


which also specifies the action on I by pullback. 

In our example of quantum torus algebra, S = Z, so that T = U(1) x U(1). If 
we abuse notation, we can denote the image of g (the choice of central character) 
simply by q. Of course, Schur’s lemma ensures that the center must act by a chosen 
central character in any irreducible representation. This central character is nothing 
other than the numerical value of ñ, and plays the same role in this more general 
context. As such, no confusion should arise, and we will frequently confuse formal 
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and numerical q in what follows. We will denote the image of X by xı. Then the 
group action on T is just 
Y : (q, x1) > (q, x1/4), (C.12) 


and of course fixes the central character. 
It is straightforward to enumerate the orbits: 


1. q = 1. An orbitis any single point x; € U(1). The stabilizer is Z. A representation 
is thus determined by x, and another phase yı. These are the abelian representa- 
tions of Z?. 

2. q € UCL) is not a root of unity. There is a single orbit. The stabilizer is trivial. 
There is thus a unique irreducible representation up to isomorphism. (This is the 
Stone—von Neumann theorem.) 

3. q is a primitive mth root of unity um. The space of orbits is U(1)/uU,, each 
orbit consisting of m points. The stabilizer is mZ C Z. A representation is again 
determined by two phases, one being the mth power of x;, the other being (in a 
precise sense) the “mth power of y1.” 


In fact, we can construct the corresponding representations explicitly; we do this (in 
greater generality) in what follows. 


C.1.2 Non-unitary Representations 


Let us first fix q to be a primitive mth root of unity, corresponding to the third 
case above. There is then an obvious unitary finite-dimensional representation of the 
quantum torus algebra given by the well-known “clock” and “shift” matrices, acting 
on a standard vector space C” with basis e;: 


fe = eigi, We; = qe. (C.13) 


It is clear that mapping X > € and Yt w defines the structure of an m- 
dimensional QT-module with central character g. What is perhaps slightly less 
obvious is that every such representation is closely related to this one, differing only 
by a rescaling. 


Definition C.4 (cyclic representation) Fix a pair À = (Xm, Ym) E€ C* x C%. Let xı 
and yı be any mth roots of xm and y,, respectively. Then the cyclic representation of 
weight A, denoted .¥%, is defined on an m-dimensional complex vector space by the 
map 

OT > End(.¥*): X > xé, YR yw. (C.14) 


(Note that the isomorphism type does not depend on the choices of x; and y1.) We 
may sometimes write FÀ to specify the dimension of the representation. 
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For an mth primitive root of unity q, it is known [9, 99, 100] that every rep- 
resentation of QT in which X and Y are invertible is a direct sum of irreducible 
representations of the form F^ for some choices of weights. Two representations 
F` and F~ are isomorphic precisely when \ = A’. Note that the weight À and 
q together define a central character in this instance. Any representation must fac- 
tor through the quotient QT /(q™ — 1), in which the elements X” and Y” are also 
central. 


If q is generic, we have no hope of finding a finite-dimensional representation 
by the results of the previous subsection, but the construction above generalizes 
to produce an infinite-dimensional module. Let Y = C[q*, X*] be the space of 
Laurent polynomials in the central generator g and the variable X. We can define an 
analogue of the operator w~ above by the rule 


w X'=q'x'. (C.15) 
The role of the matrix € will be played simply by multiplication by X. 


Definition C.5 (polynomial representation) Choose a weight y; € C*. The polyno- 
mial representation of weight yı, denoted Y»", is defined by the map 


OT > End( 2P"): X > X, Y > yw. (C.16) 


It is clear that the shift automorphism (multiplication by X) intertwines the represen- 
tations Z”! and 2/4, However, this automorphism is outer (it is not conjugation by 
X, but rather a generator of SL(2, Z)), so that these representations are not actually 
isomorphic. 


C.1.3 Geometric Viewpoint 


To obtain a geometric perspective on its representation theory, we will take a slightly 
different way of looking at the algebra QT. If we set q = 1 (or, equivalently, taking 
the quotient of QT by C[S]), we obtain a commutative group algebra. We are free 
to think of any commutative algebra as the coordinate ring of a certain affine space. 
For our example, it is indeed the product of two punctured affine lines: 


OT —> O(C* x C*). (C.17) 
q> 


This space will play an important role in the sequel, and so we will denote it by X. 
In this paper, we consider the representation theory of more complicated algebras, 
and X will therefore denote more complicated spaces, depending on the context. (As 
our main interest, X in Chap. 2 is the moduli space of flat SL(2, C)-connections on 
the once-punctured torus.) 
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What is common between all of these examples are certain key properties of X: 
First of all, it will always be a non-compact complex manifold, so that it has a large 
and interesting algebra O(X) of holomorphic functions with polynomial growth at 
infinity. (In fact, in this paper, X will always be an affine variety over C.) It will also 
be a holomorphic symplectic manifold; in our current example, there is a natural 
holomorphic symplectic form on C* x C*, which we take to be 


1 dX dY 
pay A A (C.18) 
In our examples, X will be even hyper-Kähler; for reasons that will become clear 
later, we refer to the complex structure whose holomorphic symplectic structure is 
of interest to us now as J, motivating the choice of notation above. In the exam- 
ple at hand, we can see the hyper-Kdhler structure explicitly by using logarithmic 
coordinates, 

X =exp(r + iy), Y =exp(p+i¢), (C.19) 


and observing that both the real and imaginary parts of 


Qy =wg +iwy = 5 (dr ndo + dpa dp) + —(dp ^do- dr adp) (C.20) 


Qn 
are real symplectic forms. The third such symplectic structure is 


1 
w= z- (ar ade + dp Ade): (C.21) 
Tv 


it arises by identifying our space with the cotangent bundle of the two-torus. 
Of course, it is also trivial to see that this space admits an elliptic fibration, which 
can be written very simply in coordinates as 


t: X —>C, 
(C.22) 
(X, Y) > (r, p). 

It is apparent that this map is holomorphic in complex structure /, and that its fibers 
are tori which are Lagrangian with respect to wy and wg. As such, in the language 
of mirror symmetry for hyper-Kähler manifolds [84, 117], they are appropriate sub- 
manifolds to support branes of type (B, A, A), which are the only topologically 
interesting compact Lagrangian branes in the A-model of (X, wg). 

In addition, QT is actually the deformation quantization O7(C* x C*) of the 
coordinate ring with respect to the Poisson bracket defined by 27. We can thus begin 
to think about the algebra QT within the context of brane quantization [85] in 2d 
sigma-model, which is reviewed in Sects.2.3 and 2.4. It is the central idea of this 
paper, and this rather simple setting in this Appendix is instructive guidance for 
a similar geometric angle on DAHA in Chap. 2. (See also [139] for the geometric 
approach to the quantum tori.) 
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C.2 Branes for Quantum Torus Algebra 


We have understood the representation theory of QT. Also, we recall that the cur- 
vature F of the Bec line bundle in 2d sigma-model on the symplectic manifold 
(X = C* x C*, wx) is subject to 


Qy 
F + B + lWwWey = Ws 
ih 
to obtain OT as Hom(Be¢c, Bec). Now, we set up an equivalence between the cate- 
gories Rep(QT) and A-Brane(X, wx) by finding A-branes for the cyclic representa- 
tions (C.14) and the polynomial representations (C.16). It is the essential motivation 
for the study of our main examples, DAHA, but this builds intuition for the sorts of 
matching in Sects. 2.5 and 2.6.1. 


C.2.1 Cyclic Representations 


Our first attempt will be to find A-branes for the finite-dimensional representations 
(C.14). On general grounds, these should arise from branes supported on compact 
Lagrangians. These branes are special because, from the geometry viewpoint, com- 
pact Lagrangian submanifolds are interesting and somewhat rare. Similarly, finite- 
dimensional representations are rare and distinctive from the standpoint of represen- 
tation theory. 

Due to the simple topology of ¥ ~ T*T? in this example, there is essentially 
one interesting class of compact branes: Lagrangian tori wrapping the unique gen- 
erator of H(X, Z). The condition that Lagrangians have vanishing Maslov class 
requires that no cycle in Hı (L, Z) bound a disc in X; as such, it must map injectively 
to Hı (£, Z) = Z? under the obvious map. 

These tori are holomorphic in complex structure J and holomorphic Lagrangians 
with respect to Q7 so that they can be Lagrangian submanifolds in a symplectic 
manifold (X, wx) only when w is proportional to wx. According to (2.60), we need 
to set 0 = 0, and the parameter A is real. It is easy to see that each equivalence class 
of such tori under Hamiltonian isotopies with respect to wx contains precisely one 
torus of the form m~! (r, p), i.e. a fiber of the map (C.22). It is furthermore clear that 
no two such tori are equivalent. Each A-brane thus corresponds to exactly one special 
Lagrangian brane of type (B, A, A), and branes are indexed by two real parameters 
(r, p) recording their position. (See Fig. C.1.) 

Now, as we recalled above, an A-brane is a Lagrangian equipped with (among 
other data) a flat unitary line bundle. To choose such a flat line bundle on the torus, 
we need to additionally choose two U(1) holonomies, or equivalently pick a point 
in Jac(T”) = (T?)Y. Thus, we write the two U(1) holonomies by (e’*’, e'®’). The 
set of A-branes is thus labeled by two real for the position and two circle-valued 
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(C*)x (C*)y 


Fig. C.1 A brane (red) supported on a torus fiber gives the cyclic representation and the deformation 
parameter consists of its position (r, p) and the U(1 a holonomy. A brane (blue) supported on (C*) x 
provides the polynomial representation and the deformation parameter consists of its position | y1 | 
and the U(1) holonomy 


parameters for the holonomies. This agrees precisely with the set \ = (Xm, Ym) of 
the cyclic representations F^ of QT in (C.14) where the identification is 


(Sms Ym) = (et, e+), (C.23) 


The last thing to check is the dimension of the space of open strings Hom (Bec, 
B). Since 0 = 0 in (2.60), the data of B.. consist of F + B = wy/|h| and wy = 
—wx/|h|. Also, the Chan-Paton bundle for the Lagrangian brane is endowed with 
flat connection (2.70). As a result, the dimension formula (2.73) becomes 


$ WI 1 
dim H ce = — =. 24 
im Hom(B¢-, BL) Í, E F (C.24) 


Since this is the dimension of holomorphic sections, A = 1/m for some positive 
integer m. We can interpret this as the Bohr-Sommerfeld quantizability condition 
on the compact Lagrangian branes, and we therefore recover the condition that q is 
a primitive mth root of unity for the cyclic representation. 

The involution 


C: X > X; (r, p, p, $) => (=r, p, —p, $) 


is holomorphic in complex structure J and antiholomorphic in complex structures 
J and K. The central Lagrangian torus 7~!(0, 0) is exactly the set of fixed points 
under Ç, and the A-brane on 7~!(0, 0) with the trivial holonomies gives rise to 
the unitary finite-dimensional representation, which is the third case at the end of 
Appendix C.1.1. 
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C.2.2 Polynomial Representations 


Next, we will find an A-brane corresponding to the polynomial representation 2 
in (C.16). Since it is an infinite-dimensional representation, we expect this brane to 
be non-compact. 

Let us begin by just considering Lagrangian subspaces which are isomorphic 
to T*S!, embedded such that the generator of Hı is mapped to the generator of 
H'((C*)x) under the embedding map. While this choice is not canonical, other 
classes in Hı (C* x C*) could be obtained by acting with the outer automorphism 
group SL(2, Z). We are thus interested in Lagrangians that are graphs Ty of topolog- 
ically trivial maps Y = (p, d) : (C*)x — (C%)y, which can be represented in the 
form 


Vy := {(X, Y(X)) = (r, p, plr, P), or, vy) C (C*)x x (C*)y}. (C.25) 
Recall that the symplectic form (2.60) we are using is 


0 
tie ean ^ dọ — dr adp) ~ S55 (dr adó + dp Adp), (C.26) 


The condition for (C.25) to define a Lagrangian submanifold is therefore 


sin (2 + sr) + cos 0( 22 = 5) = 0. (C.27) 


The two quantities in parentheses are just the two Cauchy—Riemann equations for 
the function Y. Therefore, the graph of a holomorphic map (C*)y to (C*)y defines 
an A-brane for any choice of wx—in fact, an (A, B, A)-brane. But the only such 
holomorphic function that is isotopic to the constant map is itself the constant map! 

Let us recall that we consider A-branes up to Hamiltonian isotopy. The Hamilto- 
nian vector field associated to a generating function f(r, p) is 


= Of 0 . OF 0 . ðf 0 fə 

Xy = 2nihileoso(S Ip De aa in (5, dp de ral (eB 
which generate the Hamiltonian flow of the form 

do = cos OL + sin 2, öp = eos 0F — sino. (C.29) 


It is easiest to understand the action of these vector fields if 6 = 0. Choos- 
ing f(r, p) =r then generates a global rotation of ¢ in (C*)y, constant over the 
Lagrangian, and any radially-dependent rotation can also be obtained by a suit- 
able choice of f. As such, the angle ¢ can be set to any chosen value anywhere 
on the Lagrangian; angular displacements do not lead to different objects in the 
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A-model of (X, wx)! The other Hamiltonian vector field ensures that we can deform 
our Lagrangian by a Hamiltonian isotopy to set p(r, p) to its average value over p, 
depending (in principle) on r. But the Lagrangian condition (C.27) then ensures that 
p is just constant. 

As such, every A-brane in (X, wx) of topological class C* can be brought by 
Hamiltonian isotopy to a unique (A, B, A)-brane which is a fiber of the projection 
on the second factor of C* x C*. This makes it easy to see that the Maslov class is 
zero; we can consider the symplectic universal cover of C* x C* by C?, and such 
Lagrangians descend from affine subspaces there (which always have zero Maslov 
class). 

There are exactly two real parameters defining an (A, B, A)-brane of this form in 
the category A-Brane(X, wx): the modulus |Y | (or p) and the U(1) holonomy of the 
flat bundle over the Lagrangian due to H; (L, Z) = Z. This matches precisely with the 
C* parameter yı for the polynomial representation Y»'. Indeed, the representation 
space was just the algebra C[q*, X*] of Laurent polynomials, which is exactly the 
collection of holomorphic functions (in complex structure J) on this brane. 

The story for generic values of is similar. However, the integral curves of the 
Hamiltonian vector field generated by ð f/Or are no longer closed circles, but rather 
spirals in C* (obtained as the images of lines of fixed slope under the exponential 
map). 


C.3 Symmetrized Quantum Torus 


Now let us move one step forward to DAHA. Recall from (C.5) that the outer automor- 
phism group of QT is SL(2, Z). How much of this symmetry is visible in the classical 
limit? Since the classical limit corresponds to a trivial choice of the central character 
(or, equivalently, to the quotient by the ideal (q — 1)), all inner automorphisms must 
act trivially, so that the residual symmetry is by the group Out(Q7T) = SL(2, Z). 
Indeed, this is just the natural action of the group of canonical transformations on 
symplectic Z?. Of course, these automorphisms act on X by the exponentiated form 
of this action: 


ab 


SL(2, Z) 5 e d 


) : (X.Y) > tig wr) (C.30) 

We will be particularly interested in one distinguished outer automorphism of 
order two, namely the central element « of SL(2, Z). Let us study the extension of OT 
by this outer automorphism. In other words, we are interested in the algebra H,—, 
defined by the short exact sequence 


0> OT > Hz; > CIZ] > 0, (C.31) 
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with respect to the outer automorphism x. (Of course, this is just obtained by applying 
the group algebra functor to a corresponding semidirect product of groups.) We can 
think of this as adjoining a new generator T of Z to QT, subject to the relations 


Psi, TXT=X", TYT =Y. (C.32) 


In the classical limit, Ë, is not commutative. We therefore have no hope of 
telling a story analogous to the one we have been building for QT. However, rather 
than studying ÄË,—;—which is like a k-equivariant version of QT—directly, we can 
imagine trying to replace it by a -invariant version, whose classical limit should be 
(the functions on) the quotient of X by x. 

This is concretely accomplished as follows. The algebra Ë, contains an idem- 
potent element e = (1 + T)/2, which one can think of as implementing projection 
onto «-invariants. We can therefore define the subalgebra 


SË, = eH,—1e. (C.33) 


In fact, the algebras SH. and Ë, are Morita equivalent; this equivalence is wit- 
nessed by the bimodule eË, [130, 131], and it is also discussed in Sect. 4.3. We 
are thus free to study the representation category of either, and in the classical limit, 
we have that 

SË, T O(X)” = O[(C* x C*)/Z2]. (C.34) 


However, there is one subtlety. Since the geometric | ramification parameter t and 
DAHA parameter t are related in (2.52), t = 1 means f = q7 2 . Therefore, SË,- ı can 
be understood as the deformation quantization of the coordinate ring of 
Meaat(Cp, SL(2, C)) with ramification 


Yp tidy = ih. (C.35) 


Or, we believe that this 5 shift is related to the orbifold (Gepner) point (Xp, Bp, 
Yp>Np) = (0, 0, 0, 5) (5, 21, 45, 152] in the sigma-model on (C* x C*)/Z. In 
fact, the evaluation of the left-hand side of (2.62) at the orbifold point yields L, If 
(wz! (F + B))*? = —1is satisfied, the canonical coisotropic brane Bec can exist at the 
orbifold point. However, Bec at the orbifold point is obscure because of the stringy 
nature so that we leave it for future work. Also, it is worth noting that the skein algebra 
Sk(T7) of a torus discussed in Sect. 2.5 is isomorphic to SH,=1. Hence, Sk (T?) is not 
simply the deformation quantization of the coordinate ring of Maa(T?, SL(2, C)). 
This stems from the fact that a Higgs bundle over a genus one curve C = T? is not 
stable. Thus, we need to take into account the quantum correction described above. 

Now let us consider representation theory of SH,=1. How can we study represen- 
tations of SH, using the information we have from the non-equivariant case? In 
particular, can we make use of our understanding of QT-modules? Our situation is 
summarized by the following diagram: 
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T (C.36) 
`A 
OT —> End(U) 


The astute reader will notice that there seems to be an obvious arrow missing 
in (C.36) above. Isn’t SH, simply the invariant subset of QT with respect to the 
action of &? The answer is yes, but not canonically. Indeed, an outer automorphism 
is an equivalence class of automorphisms, and we must choose a particular lift to a 
specific non-inner automorphism in order to even talk about the action of x on QT. 
For example, we could take 


R:Xe X! Ye Y, (C.37) 


but any other choice that shifts X and Y by powers of q is equally valid and does not 
change the structure of the extension Aye). 

Let us fix the lift (C.37). It is then clear that the data of a lift of a QT -module U to 
an H, 1=1-module consists of an order-two endomorphism 7 of U such that conjugation 
by 7 and intertwining with any lift of the outer automorphism « to an automorphism 
of QT. That is, the diagram 


OT —> End(U) 


{a |r (C.38) 


QT —> End(U), 


should commute, where the action of T on End (U) is by conjugation. We can therefore 
lift the classification of QT-modules to H,=, by classifying such lifts, and we will 
do this in the next subsection. 


C.3.1 Representation Theory 
In this subsection, we consider each QT -module in turn. A lifting datum for a module 
U consists, as above, of an order-two endomorphism 7 of U that intertwines with &. 


Proposition C.6 Lifting data for the polynomial representation P! exist precisely 
when y? = q! for some integer £. When this condition holds, there is a unique lift up 
to a sign. 


Proof Let us consider the matrix elements of 7 in the polynomial basis: 
F(X) = 4X". (C.39) 


We first consider the requirement imposed by conjugating with X: 
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-1 
TX = XT => Ti+) = Ti(j+l)- (C.40) 
This means that we can write our map in the form 


T: Xi X ax (C.41) 
7 


for some constants ap. It remains to consider the action on Y: 


TY =Y lT > yq ‘apX¢ ‘= agyi q! igt i 
Ao y (C.42) 
=> uyi — gq) = 0. 


From here it follows that ag = 0 unless £ is chosen such that y? = q‘. In order to get 
an involution, we must choose ay = +1. Since q is not a root of unity, this completes 
the proof. 


Note that the freedom in the choice of £ is not very interesting: it is always 
possible to shift yı > y,/q by a (non-inner) automorphism of the algebra. Hence, 
setting £ = 0, we may consider T(X) = X~!, and the polynomial representation can 
be lifted when y; = +1. 


Proposition C.7 Let q be a primitive mth root of unity. Lifting data for the cyclic 
representation FÀ exist precisely when both weights are equal to plus or minus one. 


As above, there is then a unique lift up to a sign for each integer £ (mod m). 


Proof The calculation proceeds along similar lines. By conjugating with X, we 
obtain the requirement 
-1 
XT 4 {7 = X] Ti+) (C.43) 


Since the indices are cyclic, this requirement can only be satisfied if x?” = 1, i.e. if 


the weight xm = +1. The calculation for Y is identical, and produces the restriction 
aly? — q") =0. (C.44) 
Since g is an mth root of unity, this implies that y,, = +1. 


This completes the story as to lifting of irreducible representations of QT. How- 
ever, it is important to note that reducible representations can admit interesting new 
choices of lifting datum! 


Proposition C.8 Lifting data for the representation P”! @ Pi exist whenever 
y= q/x; for some £. When this is true, there is a unique lift up to sign. If either 
yı or y; satisfies the conditions of Proposition C.6, additional lifts correspondingly 
exist. 


Proof This proceeds by computation, as above. 7 can be decomposed into four 
blocks, each of which must satisfy (C.40) independently; correspondingly, there are 
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four undetermined constants, which we will call ae, be, ce, and de. The conjugation 
by Y then produces the conditions 


ay? — 9°) = dey — 9 =0, bey, — 9) = 0y — 9) = 0. (C45) 
The conditions are decoupled and those on a and d just recover the conditions of 


Proposition C.6. The new conditions will also be satisfied for at most one choice of 
£, and we must choose bece = 1 to obtain an involution. 


Proposition C.9 Let gq be a primitive mth root of unity. Lifting data for the represen- 
tation Fe D FX consist whenever Xmx/, = 1 and ymy,, = 1. When this is true, there 
is a unique lift up to sign. If either yı or y; satisfies the conditions of Proposition C.6, 
additional lifts correspondingly exist. 


Proof As above, the diagonal blocks reduce independently to the previous case 
(Proposition C.7). The conjugation by X leads to the condition 


XT EHy 7 =X TH+) (C.46) 
on the off-diagonal block; from cyclicity it then follows that xx; is an mth root of 


unity, and therefore that x,,x/, = 1. The calculation for Y is identical, but reduces as 
in the proof of Proposition C.7 since q is an mth root of unity. 


After choosing &, the algebra SË,- maps injectively into QT, and we can there- 
fore pull back representations. Consequently, the polynomial representation, the 
lift of AP" Pi with yıyı = 1, generically becomes an irreducible representa- 
tion of SH, on Laurent polynomials which are not symmetrized. However, when 
yı = +1, (or, to be precise, y? =q' for £ € Z), the spectrum of the Y-operator 
on Z+! becomes two-fold degenerate under Y +> Y~!. Thus, A*! is compatible 
with the outer automorphism Å. Correspondingly, the representation Y*! splits into 
two isomorphic irreducible representations on symmetric and antisymmetric Laurent 
polynomials. 

For finite-dimensional representations, the story is identical. The pullback of the 
lift of FA D Fe to SË, is generically irreducible, but becomes reducible when 
m = 2n is even and ym = +1. Precisely in this case, it becomes an n-dimensional 
representation of SH, on symmetric Laurent polynomials, modulo the ideal (X” + 
xX"), 


C.3.2 Corresponding Branes 


While we need to take into account the quantum correction (C.35), SË, is related to 
the coordinate ring on (C* x C*)/Z as in (C.34). Therefore, let us briefly consider 
the interpretation in terms of the A-brane category on (C* x C*)/Zo. 
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First, we consider A-branes corresponding to the polynomial representations. 
As in Appendix C.2.2, an A-brane for the polynomial representation of SH, is 
supported on the constant locus of the symmetrized function Y + Y~!, and it stays 
an A-brane at any value of fi since it is of type (A, B, A). Its preimages to C* x C* 
are generically two distinct branes supported on the (C*)x planes with the values 
of Y related by y, y; = 1. This corresponds to the representation of SË,- 1 ON non- 
symmetric Laurent polynomials corresponding to Proposition C.6, and it has the 
deformation parameter valued in C* for positions and the U(1) holonomy. However, 
at a fixed point of the Z, action, only one brane for Z+! can be symmetrized into 
a brane on C*/Z2, and it therefore gives rise to the representation on symmetric 
Laurent polynomials as in Proposition C.6. The extensions of these representations 
to DAHA are discussed in Sect. 2.5. 

Since the target (C* x C*)/Z, is the moduli space of flat SL(2, C)-connections 
over a torus T?, it admits an elliptic fibration called the Hitchin fibration, which 
was discussed in Sect. 2.1. Roughly speaking, the elliptic fibration can be obtained 
by identifying the elliptic fibers in (C.22) at (r, p) and (—r, —p) so that there is a 
singular fiber T7/Z> at (r, p) = (0, 0). Analogous to Appendix C.2.1, an A-brane 
supported on a generic fiber in the Hitchin fibration gives rise to an m-dimensional 
representation when i = 1/m for m € Zo. Since its preimage in C* x C* under 
the Z2 quotient consists of two distinct tori at different positions, it is precisely the 
pullback of the lift of FÀ ® gx in PropositionC.9. Consequently, there is the 
deformation parameter for a position at the base and the U(1) x U(1) holonomy of 
the A-brane on a generic fiber. The fiber at the center (r, p) = (0, 0) in (C.22) is fixed 
as a set under the Z, action so that the singular fiber in the Hitchin fibration is doubly 
covered by the torus. Thus, if the representation ¥{*!+) is even-dimensional (m = 
2n), the corresponding A-brane degenerates two copies on the singular fiber. The A- 
brane with support on the singular fiber brings about the n-dimensional irreducible 
representation of SË,- ı on the symmetric Laurent polynomials, obtained by the 
pullback of the lifting FL LÆD_ There are no longer any deformation parameters, 
as this brane does not belong to any continuous family of A-branes. As explained in 
Sect. 2.4, a Chan-Paton bundle is generally endowed with a flat Spin‘ structure and 
the choice of signs corresponds to that of a flat Spin“ structure with no holonomy 
(equivalently Spin structure in this case) of Kẹ 1/2. Indeed, the plus sign + is the 
Ramond spin structure on a circle (a trivial real line bundle over a circle), and the 
minus sign — is the Neveu-Schwarz spin structure (see Sects. 2.6.2 and 2.7). 

Although we see similar phenomena in branes for DAHA, finite-dimensional 
representations of DAHA are much richer because compact Lagrangians in the target 
for DAHA are more intricate, which is the main subject in Chap. 2. 


Appendix D 
3d N = 4 Theories and Cherednik Algebras 


In this appendix, we shall briefly discuss the relationship between Coulomb branches 
of 3d N = 4 theories and the trigonometric and rational degeneration of DAHA of 
type Aı. The connection of the deformation quantization of Coulomb branches of 
3d N = 4 theories to variants of Cherednik algebras has been studied in [16, 18, 
106, 133]. Here we shall provide a brief review as well as some implications to 
representation theory from brane quantization. 


D.1 Coulomb Branches of 3d VV = 4 Theories 


Ifa 3d N = 4 theory admits Lagrangian description, a Lagrangian is described by a 
3d N = 4 vector multiplet V anda 3d M = 4 hypermultiplet H of gauge group G in 
a representation R of gauge group G. Moreover, they can be constructed a 3d V = 2 
vector multiplet (A,,, o, Aq, d) and a 3d N = 2 chiral multiplet (yp, Ya, F) where o 
is a complex scalar, and ø is a real scalar which can be regarded as the reminiscent of 
the A3 component of 4d gauge field. In fact, the M = 4 vector multiplet consists of a 
3d.N = 2 vector multiplet (A, 0, Aa, d) anda3d.N = 2 chiral multiplet (yp, Ya, F) 
in the adjoint representation, forming 
Y= (A, Maaa> Pab, Dzi). 

The gauge field A,,, gaugino Agga, scalar ®ap and auxiliary field D}; transform 
in the trivial, (2, 2), (3, 1), and (1, 3), respectively, under the SU(2)c x SU(2)H 
R-symmetry of a 3d MN = 4 theory. The M = 4 hypermultiplet consists of N = 2 
chiral multiplets in the representation R and its conjugate representation R, forming 


H = (qas Gas Voa Poa) (D.1) 
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The scalars ga, gq and their fermionic superpartners Yaa, Daa transform as (1, 2) and 
(2, 1), respectively, under the R-symmetry. 

An N = 4 gauge theory generically has a union of moduli spaces of vacua, called 
Coulomb branch and Higgs branch. The Higgs branch is a hyper-Kähler manifold, 
known as a Nakajima quiver variety [126], parameterized by the expectation val- 
ues of gauge-invariant operators in hypermultiplets. The Coulomb branch Me isa 
hyper-Kähler manifold parameterized by the expectation values of gauge-invariant 
combinations of scalars in vector multiplets and monopole operators. 

In an abelian gauge theory, the classical Coulomb branch is R? x S! where R? is 
spanned by the expectation values of the complex scalar yand R x S! is by that of the 


monopole operators v® = e Eg latin) . Note that y is a periodic scalar y ~ y + 27g? 
called “dual photon” subject to dy = xd A. However, it is well-known that a 3d 
N = 4 Coulomb branch receives quantum corrections, which deform the classical 
moduli space. For instance, quantum corrected Coulomb branches in abelian gauge 
theories have been investigated in [10, Sect. 3]. 

In a non-abelian gauge G theory, the scalars in the M = 4 vector multiplet take 
expectation values in the Cartan subalgebra t C g. For generic expectation values, the 
gauge group is broken to a Cartan subgroup T = U(1)"*© C G. Therefore, around 
a generic point, the Coulomb branch is locally (R? x S1)*(®, However, the Weyl 
group W acts on the scalars as a residual gauge symmetry. In addition, it receives 
both perturbative and non-perturbative quantum corrections. In the end, the Coulomb 
branch is birationally equivalent [18] to 


R? x S1C) 
MẸ x E (D.2) 


Moreover, it admits an interpretation as an integrable system 
T: MZ > CKO) (D.3) 


where a generic fiber is (C*)"*. This projection can be obtained by forgetting 
about monopole operators, and the base C'* is parametrized by the gauge-invariant 
operators Tr(y”) of the complex scalar. 

If a theory is the reduction of a 4d M = 2 theory of class S on S!, the projection 
(D.3) can be interpreted as a partial decompactification of the corresponding Coulomb 
branch Mc(C, G, L). As explained in Sect. 4.1, the Coulomb branch Mc(C, G, L) 
of a 4d N = 2 theory T[C, G,L] of class S on S! x R? where S! is a circle of 
radius R is a hyper-Kaéhler manifold (say, dimg M g (C, G) = 4r). It is moreover 
a completely integrable system so that a generic Hitchin fiber is a complex tori of 
volume 1/R” which is homeomorphic to T”. As S! shrinks R — 0, a generic fiber 
is decompactified to (R x S!)", and its volume diverges to infinity. Hence, a generic 
fiber and the base in (D.3) locally parametrized by the monopole operators and the 
complex scalars yy, respectively, are holomorphic in complex structure /. 
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D.2 3d.N = 4 Coulomb Branches and Cherednik Algebras 


Trigonometric Cherednik Algebra 


Let us consider the 3d M = 8 theory, which consists of a vector multiplet and a 
hypermultiplet in the adjoint representation. It is a reduction of the 4d M = 4 theory 
on a circle S!. The Coulomb branch of the 3d M = 8 theory with gauge group G is 


actually 
tc x TY 


and it is indeed free from quantum corrections. Although the SU(2)c symmetry 
treats all the hyper-Kahler complex structures (7, J, K) equally, it is natural to take 
a viewpoint holomorphic in complex structure J to see the connection to Cherednik 
algebra. A supersymmetric Wilson loop Tr exp fyi (A + p) in 4d reduces to the com- 
plex scalar y in 3d whereas an ’t Hooft operator in 4d becomes a monopole operator 
in 3d. As a result, Mi is the trigonometric degeneration of (4.19) by taking the 
Cartan subgroup Tc to the Cartan subalgebra tc.” 

It is clear from (B.25) that the quantized Coulomb branch of the 3d MN = 8 theory 
and its mass deformation are related to the spherical subalgebra of the trigonometric 
Cherednik algebra SH ti (W). To see this, let us consider the case of rank one. If the 
gauge group is either SU(2) or SO(3), the Coulomb branch (D.4) is (C x C*)/Zo, 
which has two A; singularities. However, the dual maximal torus is TY = tc/Q 
where Q(SU(2)) = P(SO(3)) c P(SU(2)) = Q(SO(3)) so that the SO(3) Coulomb 
branch is a double cover of the SU(2) Coulomb branch. Therefore, the quantized 
Coulomb branch of the SO(3) theory is isomorphic to the spherical trigonometric 
Cherednik algebra SH? o at c = 0. On the other hand, the quantized Coulomb 


branch of the SU(2) theory is the €-invariant subalgebra of SH. aa generated by 


v=ex’e, and y>—1=(¥7+14+Y~)e, 


where the notation is the same as Appendix B.2.3. In other words, the SO(3) theory 
is endowed with the minimal monopole operator whereas the SU(2) theory is not. 
This is consistent with what we have seen for °t Hooft operators in the SO(3), and 
SU(2) 4d N = 4 theory, respectively, in Sect. 4.1. 

Turning on mass parameters breaks a half of supersymmetries and it is called 
3d N = 4* theory. Correspondingly, the two A, singularities turn into two excep- 
tional divisors in the SO(3) Coulomb branch. (Fig. D.1.) The three complex struc- 
tures (I, J, K) of the 3d NV = 4* SO(3) Coulomb branch MH inherits from those 


2 In [35, Sect. 1.6], the trigonometric limit is taken in the S-dual side, Te => tt, instead. However, 
the trigonometric limit Tc — tc of the Wilson loop is more natural from the physical viewpoint. 
Therefore, among the two polynomial representations in Appendix B.1.7, the difference-rational 
polynomial representation is more natural than the differential polynomial representation for the 
reduction from 4d to 3d. 
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of the Coulomb branch Mc(C,, SO(3)+) in Sect.4.1. At the classical level, the 
period integrals of (w;, wy, wg) over an exceptional divisor provide the parame- 
ters (Xp, By, Yp) as in (2.24). Indeed, the complex mass parameter of the adjoint 
hypermultiplet is Bp + ¿Yp whereas «, corresponds to the real mass parameter. The 
triple (Xp, Bp, Yp) is transformed as the scalars ® = (ø, p) in the N = 4 vector 
multiplet under SU(2)c. Consequently, the quantized Coulomb branch of the SO(3) 
3d N = 4* theory is isomorphic to the spherical trigonometric Cherednik algebra 
SH. 

Thetefore, the representation theory of the algebra can be studied in the context 
of brane quantization analogous to Chap.2. However, we should note that there is 
one difference between 3d M = 4 theories and 4d VV = 2 theories. In trigonometric 
Cherednik algebra (B.37), one can set h = 1 by redefinition x > hx,c — hc. Hence, 
we can consider the 2d A-model on the 3d M = 4* SO(3) Coulomb branch X with 
a fixed symplectic form wx = —wx where the parameter of Sam is identified by 
c = —a,/2. More generally, once we fix a complex structure of any 3d MN = 4 
Coulomb branch in which deformation quantization is performed, a symplectic form 
can be set to a particular Kahler form thanks to the SU(2)c symmetry. On the other 
hand, a 4d NV’ = 2 superconformal theory is endowed with the U(1), x SU(2)q R- 
symmetry, and U(1), rotates only wy and wx. As a result, A cannot be fixed to a 
particular value, and the story becomes more delicate as seen in Chap. 2. 

Without loss of generality, we can hence consider that the target X of the 2d 
A-model is the 3d M = 4* SO(3) Coulomb branch with 


Xp # 0, Bp =0= Yp (D.5) 


and the symplectic form is wx = —wx. The target can be understood as a partial 
decompactification of the Coulomb branch Mc(C,, SO(3)+) in Sect.4.1 with the 
same ramification parameters (D.5) along the x-direction. Upon 3d reduction, the 
singular fiber of type Jj in Mc(C,, SO(3),) —> Bu is decompactified to the left of 
Fig. D.1, which consists of a cigar and the two exceptional divisors, denoted by D; 
and D3. Consequently, finite-dimensional representations come from branes Sp, and 
p, supported on the two exceptional divisors in Fig. D.1 that can exist only when 
c = —(2¢ — 1)/2 as in Sect.2.6.4. Moreover, they are related by the £-reflection 
gy > 2P. Indeed, the finite-dimensional representations of SH 1i (and SH re) are 
classified by [14, 52, 148], and this conclusion is consistent with [14, Proposition 
7.1]. 

Let us remark the indications from the brane quantization on distinguished infinite- 
dimensional representations of SH tas that stem from branes supported on a generic 
fiber C* of (D.3) and the cigar in 7~!(0). A brane supported on a generic fiber 
is labeled by a holonomy yo of the Spin‘-bundle around S! C C% and a position 
v of the base in (D.3). Hence, we denote the corresponding infinite-dimensional 
representation by V2°"". The y-weights of this representation are unbounded below 
and above. On the other hand, for a brane supported on the cigar, the y-weights of 
the corresponding representation, say Veigar, are bounded below. The distinguished 
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infinite-dimensional representations Vc» and Veigar are analogous to the principal and 
discrete series of SL(2, R), respectively. 

As in Sect. 2.7, we can consider bound states of branes. For instance, when c = 
—(2€ — 1)/2, the bound state of Bp, and the brane supported on the cigar gives rise 
to the short exact sequence 


0 —> (Vag) — VË — 9? — 0, i =1,3. (D.6) 


This is analogous to (2.141). On the other hand, in the case of no holonomy with 
Ramond spin structure yo = +, it can enter the singular fiber 7~!(0) when c € Z, 
which yields 

0 —> K(Vagar) — VE? — Vro — 0. (D.7) 


This is analogous to (2.148). 

If G = SU(2), the mass deformation develops only one exceptional divisor D; 
(no D3) and the singular fiber m~! (0) has one A, singularity. The quantized Coulomb 
branch of the 3d VV = 4* SU(2) theory is the €-invariant subalgebra of SH' as 

We have seen that the Coulomb branch of the 4d M = 4 theory on S! x R can 
be constructed from affine Grassmannian Steinberg variety R in (4.17). Indeed, the 
Coulomb branch of the 3d M = 8 theory can be obtained by taking the spectrum of 
the G£ -equivariant Borel-Moore homology of R [16, 18] 


Spec HEE (R) = £ = Mil @) |: (D.8) 


By introducing the same equivariant action as in (4.20), we obtain the quantized 


Coulomb branch Hee AE (R) of the 3d N = 4* theory. If G = SU(N)/Zy, 
then it is isomorphic to the spherical subalgebra SH (6 n) of the trigonometric 
Cherednik algebra of type Ay_1. 

Motivated by this construction, the mathematical definition of Coulomb branches 
of general 3d M = 4 quiver theories has been given in [17—19]. In addition, repre- 
sentation theory of a 3d M = 4 quantized Coulomb branch has been studied in the 
context of boundary conditions of 3d M = 4 gauge theory in physics literature [11, 
12, 42]. Their K-theoretic version will potentially lead to a vast generalization of 
DAHA as in [13] and its representation theory. 


Rational Cherednik Algebra 


The Coulomb (and Higgs) branch of the 3d MN = 4 SQED with massless 2 flavors 
is C?/Z2. Once the mass parameters are turned on, the A, singularity of C?/Z2 
is resolved, and the resulting manifold is called the Eguchi-Hanson space T*CP!. 
From its complete hyper-Kahler metric, it can be regarded as S! fibration over R? 
where the fiber shrinks at two points in R°. For instance, the detail can be found in 
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er, 
Nay, 


Fig. D.1 (Left) Real locus of the Coulomb branch of 3d M = 4* theory with SO(3) gauge group. 
(Right) Real locus of the Coulomb branch of 3d M = 4 SU(2) theory with one adjoint and one 
fundamental hypermultiplet 


[85, Sect. 3.7]. The deformation quantization of the Eguchi—Hanson space leads to 
the spherical subalgebra SH he of the rational Cherednik algebra that is isomorphic to 
the universal enveloping algebra of the ṣI(2) Lie algebra (B.41). The representation 
theory of this algebra has been exclusively investigated from the viewpoint of brane 
quantization in [85].° In particular, a brane supported on CP! c T*CP! can exist 
only when c = —(2¢ — 1)/2 like Sp, in Sect.2.6.4, and it gives rise to a finite- 
dimensional representation. On the other hand, branes supported on a cigar in Fig. D.1 
or T*S! C T*CP! bring about a discrete or principal series of SL(2, R). We refer 
the reader to [85] for more details. 

Now let us consider the 3d M = 4 U(N) gauge theory with one adjoint and one 
fundamental hypermultiplet. If the theory is massless, the Coulomb branch [41] is 
the Nth symmetric product of C? 


Me oo) | = Sym” C’. 


Consequently, its coordinate ring is indeed isomorphic to the spherical subalgebra 
of the gI(N) rational Cherednik algebra SH rat (gI(N)) at c = 0 = ñ. In this sense, 
the spherical rational Cherednik algebra sË rat (gI(N)) can be interpreted as a “Lie 
algebra” of the spherical DAHA SË (gI(N)). Once mass parameters are turned on, 
the Coulomb branch is the Hilbert scheme of N-points on the affine plane C?, and 
the resolution of singularities can be understood as the Hilbert-Chow map 


m : Hilb’ C? —> Sym” C’. (D.9) 


3 Precisely speaking, we need the 1/2 shift in c as in Sect. 2.3.1 to connect to [85]. 
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If we remove the center-of-mass coordinate of Hilb” , we have the spherical subal- 
gebra of the rational Cherednik algebra SH a(S N) Of type Ayn-ı- 

In the case of type A y1, itis known that Spec(SH a (Gy)) has a unique compact 
holomorphic Lagrangian submanifold, called the punctual Hilbert scheme, which is 
the preimage 7! (0) of zero under the Hilbert-Chow map (D.9). As briefly discussed 
in Sect.3.1.2, this will give rise to the unique finite-dimensional representation of 
SH™ (Gy) when c = —M/N with coprime (M, N). This is consistent with the clas- 
sification of finite-dimensional representations of the spherical rational Cherednik 
algebra [14, Theorems 1.2 and 1.10]. (See also [78, 79] for a realization by geometric 
quantization.) Moreover, the finite-dimensional module is isomorphic to the lowest 
a-degree of the HOMFLY-PT homology of the (M, N) torus knot [73]. 

As a remark, we note that the Coulomb branch of 3d VV = 4 U(N) gauge theory 
with £ hypermultiplets in the fundamental representation [41] is the Nth symmetric 
power of the hypersurface Sẹ determined by the equation xy = zt in C?, which can 


be expressed as 
MEHE] = smsa 


The deformation quantization of the coordinate ring of the Coulomb branch (a.k.a 
quantized Coulomb branch) leads to the cyclotomic rational Cherednik algebras 
[106, 134]. The £ = 0 and £ = 1 specializations are the spherical subalgebras of 
the trigonometric and rational Cherednik algebras of type GL(N, C), respectively. 
Hence, their representation theory can be similarly investigated in the context of 
brane quantization, which deserves future study. 
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